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Preface 



This text is a slightly edited version of lecture notes for a course I gave at ETH, during the 
Winter term 2000-2001, to undergraduate Mathematics and Physics students. The choice 
of topics covered here is somewhat arbitrary, and was partly imposed by time limitations. 
Evidently, these notes do not intend to replace the many existing excellent textbooks 
on the subject, a few of which are listed in the bibliography, but they might provide a 
reasonably concise, albeit certainly biased introduction to this huge domain. The approach 
used here has probably been influenced by my first teacher in Dynamical Systems, Prof. 
Herve Kunz. I also wish to acknowledge my student's contribution in mercilessly tracking 
down a substantial amount of typos. 
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Chapter 1 

Examples of Dynamical Systems 



The last 30 years have witnessed a renewed interest in dynamical systems, partly due to 
the "discovery" of chaotic behaviour, and ongoing research has brought many new insights 
in their behaviour. What are dynamical systems, and what is their geometrical theory? 
Dynamical systems can be defined in a fairly abstract way, but we prefer to start with 
a few examples of historical importance before giving general definitions. This will allow 
us to specify the class of systems that we want to study, and to explain the differences 
between the geometrical approach and other approaches. 



1.1 The Motion of the Moon 



The problem of the Moon's motion is a particular case of the A^-body problem, which gives 
a nice illustration of the historical evolution that led to the development of the theory of 
dynamical systems. This section follows mainly Gutzwiller's article [ pu98(| . 

Everyone knows that the phases of the Moon follow a cycle of a bit less than 30 days. 
Other regularities in the Moon's motion were known to the Babylonians as early as 1000 
B.C. One can look, for instance, at the time interval between Sunset and Moonrise at Full 
Moon. This interval is not constant, but follows a cycle over 19 years, including 235 Full 
Moons (the Metonic Cycle). Solar and Lunar Eclipses also follow a cycle with a period of 
18 years and 11 days, containing 223 Full Moons (the Saws Cycle). 

Greek astronomy started in the 5th century B.C. and initiated developments culminat- 
ing in the work of Ptolemy in the second century A.D. In contrast with the Babylonians, 
who looked for regularities in long rows of numbers, the Greeks introduced geometrical 
models for their astronomical observations. To account for the various observed devia- 
tions from periodicity, they invented the model of epicycles. In modern notation, and 
assuming a planar motion with Cartesian coordinates (x,y) G M^, the complex number 
z = X + iy & C evolves as a function of time t according to the law 

z = ae'^'\l + ee'''^'), (1.1.1) 

where a, e, uJi and uj2 are parameters which are fitted to experimental data. 

The epicycle model was refined in subsequent centuries, with more terms being included 
into the sum (1.1.1) to explain the various "inequalities" (periodic deviations from the 



uniform motion of the Moon) . Four inequalities were discovered by Tycho Brahe alone in 
the 16th century. These terms could be partly explained when Kepler discovered his three 
laws in 1609: 
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1. the trajectory of a planet follows an ellipse admitting the Sun as a focus, 

2. equal areas, measured with respect to the Sun, are swept in equal time intervals, 

3. when several planets orbit the Sun, the period of the motion squared is proportional 
to the third power of the semi-major axis of the ellipse. 

Expanding the solution into Fourier series produces sums for which (|lT|) is a first approx- 
imation. However, while these laws describe the motion of the planets quite accurately, 
they fail to fit the observations for the Moon in a satisfactory way. 

A decisive new point of view was introduced by Newton when he postulated his law 
of Universal Gravitation (published in his Principia in 1687). A system with N planets is 
described by a set of ordinary differential equations 

d'^Xi \ - Gmimj{xj 



|L ' .113 ' i = l,...,iV. (1.1.2) 

j=l,...,]V II * -^11 

Here the G are vectors specifying the position of the planets, the m, are positive 
scalars giving the masses of the particles, and G is a universal constant. Newton proved 
that for two bodies = 2), the equation (|1.1.2| ) is equivalent to Kepler's first two laws. 
With three or more bodies, however, there is no simple solution to the equations of motion, 
and Kepler's third law is only valid approximately, when the interaction between planets 
is neglected. 

The three-body problem initiated a huge amount of research in the following two 
hundred years. Newton himself invented several clever tricks allowing him to compute 
corrections to Kepler's laws in the motion of the Moon. He failed, however, to explain 
all the anomalies. Perturbation theory was subsequently systematized by mathematicians 
such as Laplace, Euler, Lagrange, Poisson and Hamilton, who developed the methods of 
analytical mechanics. As a first step, one can introduce the Hamiltonian function 

N ^ Ija 3\N _^ Ttt 



H : {R^r X 



/ \ ^ Pi Sr^ Gmivrij (1.1.3) 

1=1 t<] ■' 



where pi = miVi G are the momenta of the planets and = E for i = 1, . . . ,N. 
The equation of motion ( |1.1.2| ) is then equivalent to the equations 



dqi dH dpi dH 
dt dpi ' dt dqi 



(1.1.4) 



One advantage of this formulation is that all the information on the motion is contained 
in the scalar function H. The main advantage, however, is that the structure ( |1.1.4| ) of 
the equations of motion is preserved under special changes of variables, called canonical 
transformations. In the case of the two-body problem, a good set of coordinates is given 
by the Delaunay variables (/, i^) S x (actually, there are 6-1-6 variables, but 6 of 
them correspond to the trivial motion of the center of mass of the system). The action 
variables /i,/2,/3 are related to the semi-major axis, eccentricity and inclination of the 
Kepler ellipse, while the angle variables (pi,ip2, describe the position of the planet and 
the spatial orientation of the ellipse. The two-body Hamiltonian takes the form 

Hil,^) = -^^, (1.1.5) 
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where fi = ^^^^^ ■ The equations of motion are 

d/i _ dH 

dl2 _ dH 

dt 9(/72 

dis _ dH 

dt C?</33 



dyJi 






dt 






d932 


dH 


= 0, 


dt 




d¥?3 




= 0, 


dt 


" a?3 



(1.1.6) 



0, 



describing the fact that the planet moves on an elhptical orbit with fixed dimensions and 
orientation. 

In the case of the three-body problem Moon-Earth-Sun, one can use two sets of 
Delaunay variables (/, ip) and (J, V') describing, respectively, the motion of the system 
Moon-Earth, and the motion around the Sun of the center of mass of the system Moon- 
Earth. The Hamiltonian takes the form 

H{I,J,^,^)=Ho{I,J)+Hi{I,J,^,il,). (1.1.7) 

The unperturbed part of the motion is governed by the Hamiltonian 

^o(/,J) = -^-^, (1.1.8) 

where ^' = ^m^^^^]^^ ■ Due to the special initial conditions of the system, the perturbing 
function Hi has a small amplitude. It depends on several small parameters: the initial 
eccentricities e ~ 1/18 of the Moon and e' ~ 1/60 of the Earth, their inclinations i and 
i' , and the ratio a/a' ^ 1/400 of the semi-major axes of the two subsystems. All these 
quantities are functions of the actions / and J. The standard approach is to expand Hi 
in a trigonometric series 

mi + m2 a'^ ^ 



The coefficients Cj are in turn expanded into Taylor series of the small parameters, 

C^.= E^.^(4)''^'^^"^7'=^7"^ (1.1.10) 



-"3 

where 7 = sinz/2 and 7' = sini'/2. The solutions can then be expanded into similar 



series, thus yielding a Fourier expansion of the form (1.1.1) (in fact, it is better to simplify 
the Hamiltonian by successive canonical transformations, but the results are equivalent). 
The most impressive achievement in this line of work is due to Delaunay, who published 
in 1860 and 1867 two volumes of over 900 pages. They contain expansions up to order 10, 
which are simplified with 505 transformations. The main result for the trajectory of the 
Moon is a series containing 460 terms, filling 53 pages. 

At the turn of the century, these perturbative calculations were criticized by Poincare, 
who questioned the convergence of the expansions. Indeed, although the magnitude of 
the first few orders decreases, he showed that this magnitude may become extremely large 
at sufficiently high order. This phenomenon is related to the problem of small divisors 
appearing in the expansion, which we will discuss in a simpler example in the next section. 
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Poincare introduced a whole set of new methods to attack the problem from a geometric 
point of view. Instead of trying to compute the solution for a given initial condition, he 
wanted to understand the qualitative nature of solutions for all initial conditions, or, as 
we would say nowadays, the geometric structure of phase space. He thereby introduced 
concepts such as invariant points, curves and manifolds. He also provided examples where 
the solution cannot be written as a linear combination of periodic terms, a first encounter 
with chaotic motion. 

The question of convergence of the perturbation series continued nonetheless to be 
investigated, and was finally solved in a series of theorems by Kolmogorov, Arnol'd and 
Moser (the so-called KAM theory) in the 1950s. They prove that the series converges for 
(very) small perturbations, for initial conditions living on a Cantor set. 

This did not solve the question of the motion of the Moon completely, although fairly 
accurate ephemerides can be computed for relatively short time spans of a few decades. 
Using a combination of analytical and numerical methods, the existence of chaos in the 
Solar System was demonstrated by Laskar in 1989 [ La89 |, implying that exact positions 
of the planets cannot be predicted for times more than a few hundred thousand years in 
the future. 



1.2 The Standard Map 

The standard map describes the motion of a "rotator" with one angular degree of freedom 
g G S ""^ (S ^ denotes the circle M /27rZ ) , which is periodically kicked by a pendulum- like 
force of intensity proportional to — sing. If g„ and p„ denote the position and momentum 
just before the v}^ kick, one has 

qn+i=qn+Vn+i (mod 27r) (12 1) 

Pn+i = Pn - esing„. 

For e = 0, the dynamics is very simple and one has explicitly 

qn = qo + npo (mod 27r) ^ 

Pn = Po- 

Let us now analyse the iterated map ( 1.2.1]) according to the perturbative method. The 
idea is to look for a change of variables {q,p) if^I) transforming the system into a 
similar one, but without the term e 

sin ^72- Let us write 
P = 1 + 9W,I), 

where / and g are unknown functions, which are 27r-periodic in ip. We impose that this 
change of variables transforms the map ( [L.2.1 ) into the map 

ipn+l =^n + In+1 (mod 2tt) ^ 

In+l = In ='■ ^■ 

This is equivalent to requiring that / and g solve the functional equations 

f{Lp + uj,uj) = f(ip,uj)+g{ip + u},u]) (12 5) 

g{ip + uj,uj) = g{Lp,Lv) -esin((/? + /((/?, w)). 
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One can try to solve these equations by expanding / and g into Taylor series in e and 
Fourier series in ip: 



oo 



f{^,u;) = ^e^f,{^,u^) M^,u;)= ^ akA^)e"''^ (1.2.6) 

j=l fc=— oo 

oo oo 

j=l k=—oo 

We will use the expansion 

sin((/? + ef) = sinc^ + efi cos + e^(/2 cofnp - \ fl sin 99) + 0{e'^). (1.2.8) 
At order e, we have to solve the relations 

gi{ip + uj,uj) = gi{ip,uj) - simp, 
which become, in Fourier components, 



(1.2.9) 



i kcu I t i kui 

ak,ie =afc,i + Ofc,ie 
bk,i e'*^'^ = bkA — Cfe 1, 



(1.2.10) 



where c^^i are the Fourier components of sinc^, that is, ci^i = — c_i^i = 1/(2 i) and all 
other components vanish. We thus get 

e'^ e-'^ _ cos{ip-uj/2) 

9i{^,^) - 2i(i _ e*'^) ~ 2i(l - e-^^) ~ 2sin(6j/2) 

. ^ . . ^ ' ^ (1.2.11) 



2i(l-e*'^)2 2i(l-e-*^)2 4sin2(w/2)' 

Note that this is only possible for e^"^ 7^ 1, that is, u; 7^ (mod 2-k). At order -^e obtain 
similar relations as ( |1.2.1C| ), but now Ck^2 denotes the Fourier coefficients of fi{(p, lo) cos ip, 
which are nonzero for \k\ = 2. Thus g2 and /2 only exist if e^"^ 7^ 1, or w 7^ 0, vr (mod 2it). 
Similarly, we will find that gj and fj only exist if e-'"^ 7^ 1, so the equations ( |1.2.5| ) can 
only be solved for irrational a;/(27r). Even then, the expansions of / and g will contain 
small terms of the form 1 — e'*^'^ in the denominators, so that the convergence of the series 
is not clear at all. In fact, the convergence has been proved by Moser for certain irrational 
oo called Diophantine numbers \ Mo73f| . 

Now let us turn to the geometric approach. We can consider {q,p) as coordinates in 
the plane (or on the cylinder because of the periodicity of q). For given {qo,Po), the set 
of points {iqn,Pn)}n^o is called the orbit with initial condition {qo,po)- We would like to 
know what the different orbits look like. The simplest case is the fixed point: if 

qn+i = qn ^^2.12) 

Pn+l = Pn 

then the orbit will consist of a single point. The fixed points of the standard map are 
(0, k) and (vr, k) with A; G Z . We can also have periodic orbits, consisting of m points, if 

qn+m = qn ^.IS) 
Pn+m — Pn- 



CHAPTER 1. 



EXAMPLES OF DYNAMICAL SYSTEMS 




Figure 1.1. Phase portraits of the standard map, obtained by representing several orbits 
with different initial conditions, for increasing values of the perturbation s. From left to 
right and top to bottom: e = 0.1, e = 0.5, e = 0.8, e = 1.2, s = AA and e = 10. 
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Another possible orbit is the invariant curve. For instance if the equations ( 1.2.5| ) admit 
a sohition, we can write 

qn = Vn + f{Vn,uj) (mod 27r) n9 1/1^ 

Pn = UJ + g{ipn,UJ), 

where = c^q + "-i^- This is the parametric equation of a curve winding around the 
cyhnder. Since w is irrational, the points fill the curve densely. One can also analyse the 
dynamics in the vicinity of periodic orbits. It turns out that for this kind of map, most 
periodic orbits are of one of two types: elliptic orbits are surrounded by invariant curves, 
while hyperbolic orbits attract other orbits from one direction and expel them into another 
one. There are, however, much more exotic types of orbits. Some live on invariant Cantor 
sets, others densely fill regions of phase space with a positive surface. 

The aim of the geometrical theory of dynamical systems is to classify the possible 
behaviours and to find ways to determine the most important qualitative features of the 
system. An important advantage is that large classes of dynamical systems have a similar 
qualitative behaviour. This does not mean that the perturbative approach is useless. But 
it is in general preferable to start by analysing the system from a qualitative point of view, 
and then, if necessary, use more sophisticated methods in order to obtain more detailed 
information. 



1.3 The Lorenz Model 

Convection is an important mechanism in the dynamics of the atmosphere: warm air has 
a lower density and therefore rises to higher altitudes, where it cools down and falls again, 
giving rise to patterns in the atmospheric currents. 

This mechanism can be modeled in the laboratory, an experiment known as Rayleigh- 
Benard convection. A fluid is contained between two horizontal plates, the upper one at 
temperature Tq and the lower one at temperature Ti = Tq + AT > Tq. The temperature 
difference AT is the control parameter, which can be modified. 

For small values of AT, the fluid remains at rest, and the temperature decreases 
linearly in the vertical direction. At slightly larger AT, convection rolls appear (their 
shape depends on the geometry of the set-up). The flow is still stationary, that is, the 
fluid velocity at any given point does not change in time. 

For still larger AT, the spatial arrangement of the rolls remains fixed, but their time 
dependence becomes more complex. Usually, it starts by getting periodic. Then different 
scenarios are observed, depending on the set-up. One of them is the period doubling 
cascade: the time-dependence of the velocity field has period P, 2P, 4P, . . . , 2"'P, . . . , where 
the n^^ period doubling occurs for a temperature difference AT„ satisfying 

1- AT„ — AT„_i r . . f^ o ^\ 

lim = d ~ 4.4... (1.3.1) 

n^oo AT„+l - AT„ 

These AT„ accumulate at some finite ATqo for which the behaviour is no longer periodic, 
but displays temporal chaos. In this situation, the direction of rotation of the rolls changes 
erratically in time. 

For very large AT, the behaviour can become turbulent: not only is the time depen- 
dence nonperiodic, but the spatial arrangement of the velocity field also changes. 
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RB convection has been modeled in the following way. For simplicity, one considers 
the two-dimensional case, with an infinite extension in the horizontal zi-dircction, while 
the vertical .T2-direction is bounded between — ^ and ^. Let P = R X [—^,5]- The state 
of the system is described by three fields 

v:T> xR -^R^ velocity, 

T :V xR ^R temperature, (1.3.2) 

p : T> xR -^R pressure. 

The deviation 6{x,t) from the linear temperature profile is defined by 

T{x,t)=To + AT(^-X2)+Ti9{x,t). (1.3.3) 
The equations of hydrodynamics take the following form: 

— + (y.\/)0 = Ae + Rv2 (1.3.4) 
V ■v = 0. 

Here a, the Prandtl number, is a constant related to physical properties of the fluid, while 
R, the Reynolds number, is proportional to AT. Furthermore, 

^ /dp dp \ T 
\dxi ' dx2 / 

/^e- — + — 

dx\ 8x2 
dvi dv2 

^ = i^ + ir~ 

0x1 0x2 

, de dO 

[y ■ \)e = Vi- \-V2^—. 

0x1 0x2 

The terms containing {v ■ V) introduce the nonlinearity into the system. The boundary 
conditions require that 6, V2 and dvi/dx2 should vanish for X2 = ±|. We thus have to 
solve four coupled nonlinear partial differential equations for the four fields vi,V2, 0,p. The 
continuity equation V • f = can be satisfied by introducing the vorticity ip : V xR — > M , 
such that 

8x2 ' 8x\ / 

It is also possible to eliminate the pressure from the two equations for dv/8t. We are 
left with two equations for -0 and 6. The problem can be further simplified by assuming 
a periodic dependence on xi, of period 27r/g. A possible approach (not the best one by 
modern standards, but historically important) is to expand the two fields into Fourier 
series (or "modes"): 



V^(xi,X2)= «fce^'^''"^ei'' 



■nx2 



(1.3.6) 

e{xi,X2)= bj^Q^k^l^^ Q^k2^^2 
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Figure 1.2. One trajectory of the Lorenz equations (1.3.9) for a — 10, b — 8/3 and 
r — 28, projected on the (X, Z)-plane. 



(where the boundary conditions impose some relations between Fourier coefficients of the 
same |fci| and \k2\). Note that the terms of this sum are eigenfunctions of the linear 
operators in ( [1.3.41) . Plugging these expansions into the equations, we obtain relations of 
the form 



dt\bk{t)) 



(1.3.7) 



where are 2x2 matrices and the term A'^(-) comes from the nonlinear terms in (v ■ V) 
and may depend on all other k' . Without these nonlinear terms the problem would be 
easy to solve. 



In 1962, Saltzmann considered approximations of the equations ( 1.3.7 ) with finitely 
many terms, and observed that the dynamics seemed to be dominated by three Fourier 



modes. In 1963, Lorenz decided to truncate the equations to these modes p^o63(] , setting 



ip{xi,X2) = aiX(t) sin gxi cos 7rx2 

6{xi, X2) = a2Y{t) cos qxi cos 11x2 + a^Z^t) sin 277X2- 



(1.3. 



Here ai = \/2('/r^ + q'^)/{'^q), 012 = \/2a3 and 03 = (vr^ + g^)^/(vrg^) are constants 
introduced only in order to simplify the resulting equations. All other Fourier modes 
in the expansion ( |1.3.7| ) are set to zero, a rather drastic approximation. After scaling time 
by a factor (vr^ + 9^), one gets the equations 



dX/dt = a{Y - X) 
AY/dt = rX - Y - XZ 
dZ/dt = -bZ + XY, 



(1.3.9) 



where b = An / (it + q ), and r = Rq / (vr + q ) is proportional to the control parameter 
R, and thus to AT. These so-called Lorenz equations are a very crude approximation of 
the equations ( 1.3.4| ), nevertheless they may exhibit very complicated dynamics. 
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In fact, for ^ r ^ 1, all solutions are attracted by the origin X = Y = Z = 0, 
corresponding to the fluid at rest. For r > 1, a pair of equilibria with X ^ attracts the 
orbits, they correspond to convection rolls with the two possible directions of rotation. In- 
creasing r produces a very complicated sequence of bifurcations, including period doubling 
cascades [^p82 |. For certain values of the parameters, a strange attractor is formed, in 
which case the convection rolls change their direction of rotation very erratically (Fig. |1.2| ) , 
and the dynamics is very sensitive to small changes in the initial conditions (the Butterfly 
effect). The big surprise was that such a simple approximation, containing only three 
modes, could capture such complex behaviours. 



1.4 The Logistic Map 

Our last example is a famous map inspired by population dynamics. Consider a population 
of animals that reproduce once a year. Let Pn be the number of individuals in the year 
number n. The offspring being usually proportional to the number of adults, the simplest 
model for the evolution of the population from one year to the next is the linear equation 

Pn+l = XPn (1.4.1) 

where A is the natality rate (minus the mortality rate). This law leads to an exponential 
growth of the form 

P„ = A"Po = e"^''^Po (1-4.2) 

(the Malthus law). This model becomes unrealistic when the number of individuals is so 
large that the limitation of resources becomes apparent. The simplest possibility to limit 
the growth is to introduce a quadratic term —f3P^, leading to the law 

Pn+l = XPn - f3Pl (1.4.3) 

The rescaled variable x = PP then obeys the equation 

Xn+1 = f\iXn)-=XXn{l-Xn). (1-4.4) 

The map f\ is called the logistic map. Observe that for ^ A ^ 4, /a maps the interval 
[0, 1] into itself. The dynamics of the sequence x„ depends drastically on the value of A. 

For ^ A ^ 1, all orbits converge to 0, which means that the population becomes 
extinct. For 1 < A ^ 3, all orbits starting at xq > converge to 1 — 1/A, and thus the 
population reaches a stable equilibrium. For 3 < A ^ 1 + \/6, the orbits converge to a 
cycle of period 2, so that the population asymptotically jumps back and forth between 
two values. 

For A > 1 + ^/6, the system goes through a whole seqence of period doublings. Similarly 
as in RB convection, the values A^ of the parameter for which the n}^ period doubling 
occurs obey the law 

lim ^" ~ = 6 = 4.669... (1.4.5) 



where 6 is called the Feigenbaum constant. In 1978, Feigenbaum as well as Coullet and 
Tresser independently outlined an argument showing that such period doubling cascades 
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0.0 



2.0 2.4 2.8 3.2 3.6 4.0 

Figure 1.3. Bifurcation diagram of the logistic map. For each value of A on the abscissa, 
the points xiooi through a;iioo are represented on the ordinate, for an initial value xq ^ ^. 



should be observable for a large class of systems, and that the constant 6 is universal. For 
instance, it also appears in the two-dimensional Henon map 



Xn+l 
Vn+l 



1 — Ax„ + l/r, 
bXn 



0<b<l 



(1.4.6) 



Rigorous proofs of these properties were later worked out by Collet, Eckmann, Koch, 
Lanford and others |CE8C]. 

For the logistic map, the period doublings accumulate at a value Aqo = 3.56..., beyond 
which the orbits become chaotic. For larger A, there is a complicated interplay of regular 
and chaotic motion (Fig. L3), containing other period doubling cascades. Finally, for 
A = 4, one can prove that the dynamics is as random as coin tossing. 
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Chapter 2 

Stationary and Periodic Solutions 



In Chapter |T|, we have seen examples of two kinds of dynamical systems: ordinary differ- 
ential equations (ODEs) and iterated maps. There are other types of dynamical systems, 
such as partial differential equations or cellular automata. These are in general more dif- 
ficult to analyse, although some ideas developed for maps and ODEs can be carried over 
to their study. Here we will concentrate on ODEs and maps, by starting with the simplest 
kinds of dynamics: stationary and periodic. 



2.1 Basic Concepts 
2.1.1 Orbits and Flows 

Let P C M " be an open domain. One type of dynamical systems we will consider is given 
by a map F : D ^ T>. 2? is called the phase space of the system. It is possible to consider 
more general differentiable manifolds as phase space, such as the circle, the cylinder or 
the torus, but we will limit the discussion to Euclidean domains. Generalizations to other 
manifolds are usually straightforward. 

Definition 2.1.1. The (positive) orbit of F through a point xq £ D is the sequence 
i^k)k^o defined by x^+i = F{xk) for all integers k ^ 0. We have thus 

Xk = F^{x) where F^ = FoFo • • • o F (2.1.1) 

k times 

In case F is invertible, we can also define the negative orbit of xq by the relations F{xk) = 
Xk+i for all k < 0, which are equivalent to ( 2.1.1| ) if we set F~^ = [F^^)^ for all k > 0. 



The orbit of xq is then given by {xk)kei,- 
Note the trivial relation 

F'=+'(xo) = F'=(F'(xo)) (2.1.2) 

for all positive integers k, I (and all integers if F is invertible), which will admit an analogue 
in the case of ODEs. 

As particular cases of maps F, we have homeomorphisms, which are continuous maps 
admitting a continuous inverse, and difjeomorphisms, which are continuously differen- 
tiable maps admitting a continuously differentiable inverse. Similarly, for all r ^ 1, a 
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-diffeomorphism is an invertible map F such that both F and admit continuous 
derivatives up to order r. 

The ordinary differential equations we are going to consider are of the form 

x = f{x), (2.1.3) 



where / : D ^ M", and x denotes Equivalently, we can write (|2.1.3| ) system of 
equations for the components of x, 

Xi = fi{x), i = l,...,n. (2.1.4) 

P C M " is again cahed phase space and / is cahed a vector field. 

To define the orbits of /, we have to treat the problem of existence and uniqueness 
a bit more carefully. The following results are assumed to be known from basic analysis 
(see for instance |S^69|, |Har64|] or jHSTil ). 



Theorem 2.1.2 (Peano-Cauchy). Let f be continuous. For every xq G T>, there exists 
at least one local solution of ( |2.1.3| ) through xq, that is, there is an open interval I B 
and a function x : I ^ V such that x(0) = xq and x{t) = f{x{t)) for all t £ I. 

Theorem 2.1.3. Every solution x{t) with x{0) = xq can be continued to a maximal in- 
terval of existence (ii,t2) 9 0. If t2 < oo or ti > — oo, then for any compact tC dV, there 
exists a time t G (^1,^2) with x{t) ^ K, (this means that solutions will diverge or reach 
dV). 

Theorem 2.1.4 (Picard-Lindelof). Assume f is continuous and locally Lipschitzian, 
that is, for every compact IC C T>, there exists a constant L/c such that ||/(x) — /(y)|| ^ 
-^a:!!^; — y\\ for all x,y €z IC. Then there is a unique solution x{t) of ( 2.1.3| ) with x(0) = xq 
for every xq £ T>. 

Note in particular that if / is continuously differentiable, then it is locally Lipschitzian. 
We will usually consider vector fields which are at least once continuously differentiable. 

Example 2.1.5. It is easy to give counterexamples to global existence and uniqueness. 
For instance, 

X = x{t) = -j^ — (2.1.5) 

xo ^ 

has a solution diverging for t = —. A physically interesting counterexample to uniqueness 
is the leaky bucket equation 

i; = -y^. (2.1.6) 

Here x is proportional to the height of water in a bucket with a hole in the bottom, and 



( 2.1.6 ) reflects the fact that the kinetic energy (proportional to x^) of the water leaving 
the bucket is equal to the potential energy of the water inside. For every c, (|2T^ ) admits 
the solution 

.wHr- TIT p-"> 

tor t ^ c. 



In particular, for any c ^ 0, pT^ ) is a solution of (|2X^ ) such that x(0) = 0. This reflects 



the fact that if the bucket is empty at time 0, we do not know at what time it was full. 
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For simplicity, we will henceforth assume that the ODE ( |2.1.3 ) admits a unique global 



solution for all xq G V. This allows to introduce the following definitions]^ 

Definition 2.1.6. Let xq £ V and let x{t) be the unique solution of ( |2.1.3| ) with initial 
condition x(0) = xq. 

• The integral curve through xq is the set {{x,t) G D x M : x = x{t)}. 

• The orbit through xq is the set {x £T>: x = x{t),t € M}. 

• The flow of the equation ( |2.1.3D is the map 

{xo,t) ^Pt{xo) = x{t) 

Geometrically speaking, the orbit is a curve in phase space containing xq such that the 
vector field f{x) is tangent to the curve at any point x of the curve. Uniqueness of the 
solution means that there is only one orbit through any point in phase space. 

By definition, we have ifo^xo) = xq for all xq & V, and uniqueness of solutions implies 
that ipt{ips{xo)) = ipt+s{xo). These properties can be rewritten as 

ipo = id iptOips = ipt^s (2.1.9) 

which means that the family {(pt}t forms a group. Note the similarity between this relation 



and the relation ( 2.1.2 ) for iterated maps. 

Example 2.1.7. In the case f{x) = —x, x G M , we have 

(^t(xo) =xoe-*. (2.1.10) 
The system admits three distinct orbits (0, oo), (— oo,0) and {0}. 

2.1.2 Evolution of Volumes 

Let 7W C P be a compact subset of phase space. We can define its volume by a usual 
Riemann integral: 



Vol(A^) = / dx, dx = dxi . . . dx^. (2.1.11) 
Jm 



'M 

The set A4 will evolve under the influence of the dynamics: we can deflne the sets A4fc = 
F^{Ai) or A4{t) = ipt{-M). How does their volume evolve with time? The answer is 
actually quite simple. 

Consider flrst the case of a map F. We assume that F is continuously differentiable 
and denote by 

(2.1.12) 

the Jacobian matrix of F at x, which is the n x n matrix A with elements Oij = ^^(x). 



^In the case of x{t) existing for all positive t but not necessarily for all negative t, the definition remains 
valid with orbit replaced by positive orbit, flow replaced by semi-flow and group replaced by semi-group. 
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x{t) 





X3 



Figure 2.1. (a) Evolution of a volume with the flow, (b) evolution with an iterated map. 



k+l 



(2.1.13) 



Proposition 2.1.8. Assume F is a diffeomorphism and let Vk = Yol{M.k)- Then 

Proof: This is a simple application of the formula for a change of variables in an integral: 

'dF , 



I 

J A/ 



k+l 



dy 



detl |W 



dx 



det(^(x) 



dx. 



□ 



Definition 2.1.9. The map F is called conservative if 

'dF 



det(^(x)) 
The map F is called dissipative if 



1 ,dF,, 
det(-(x) 



1 



Vx G P 



< 1 Vx G P. 



(2.1.14) 



(2.1.15) 



Proposition 2.1.8 implies that Vk+i = 14 if F is conservative and Vk+i < Vk if F is 
dissipative. More generally, if |det^(x)| ^ A for some constant A and all x G T>, then 
Vk ^ X'^Vo. 

For differential equations, the result is the following: 

Proposition 2.1.10. Assume f is continuously differentiahle and let V{t) = \o\{^A{t)) . 
Then 



^V{t)= [ V-/(x)dx, 
dt JMit) 



(2.1.16) 



where V • / = ^11=1 ^ ^-^ ^he divergence. 



Proof: We have 



Vit) = dy = 

JMit) 

Let us fix X G A^, let y{t) = ipt{x) and set 



M 



dx. 



J{t):=^^Vt{xl A{t):=y-{y{t)). 
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Note that by definition of ipt, J(0) = 1 is the identity matrix. Now we can compute 
d 9 . 9 df / XX 

and thus 

^^J{t) = A{t)J{t), J(0) = 1. 

This is a hnear, time-dependent differential equation for Jit), which is known to admit a 
unique global solution. This implies in particular that det J{t) ^ Vt, since otherwise J{t) 
would not be surjective, contradicting uniqueness. Since dot J(0) = 1, continuity implies 
that det J{t) > Vt. Now let us determine the evolution of det J it). By Taylor's formula, 
there exists 9 G [0, 1] such that 

J{t + e) = J{t) + e^^J{t + Oe) 

= J{t) [1 + eJ{ty^A{t + ee)J{t + ee)] . 

From linear algebra, we know that for any n x n matrix B, 

dei{l + £B) = l + £TrS + r(£) 

with lim.^^or{e)/e = (this is a consequence of the definition of the determinant as a sum 
over permutations). Using Tr{AB) = Tr{BA), this leads to 

det J{t + e)= det J{t) [l + £Tv{A{t + 0e) J(t + ^e) J(t)"^) + r(£)] , 

and thus 

d , s det J(t + e) — det J(t) ^, s 

— det J{t) = lim ^ ^-^ = Tr(^(t)) det J{t). 

at e— >0 £ 



Taking the derivative of V{t) we get 



Tv(§^(y))dy, 

M{t) ^dx J 

and the conclusion follows from the fact that Tr || = V • /. □ 

Definition 2.1.11. The vector field f is called conservative if 

V • f{x) = Vx G P (2.1.17) 
The vector field f is called dissipative if 

V • f{x) < Vx € P. (2.1.18) 
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Proposition 2.1.10I implies that V{t) is constant if / is conservative, and monotonously 
decreasing when / is dissipative. More generally, if V • f{x) ^ c Vx G P, then V{t) ^ 
V{0) e^*. 

Of course, one can easily write down dynamical systems which are neither conserva- 
tive nor dissipative, but the conservative and dissipative situations are very common in 
applications. 



Example 2.1.12. Consider a Hamiltonian system, with Hamiltonian G 



2m 



Then x = {q,p) € 



and the equations (|l.l.4| ) take the form 

dH 

dpi 



1, . . . m 



dH 



(2.1.19) 



This implies that 



. dqi 



^ dqi \dpi) ^ dpi \ dqi) 



m + 1, . . . 2m. 



d / dH- 



(2.1.20) 



Thus all (sufficiently smooth) Hamiltonian systems are conservative. 



Exercise 2.1. Determine whether the following systems are conservative, dissipative, or 
none of the above: 



the standard map ( |1.2.1D ; 
the Lorenz model ( |1.3.S| ); 
the logistic map (|1.4.4| ); 
the Henon map (|1.4.6D. 



2.2 Stationary Solutions 

A stationary solution of a dynamical system is a solution that does not change in time. 
We thus define 

Definition 2.2.1. 

• A fixed point of the map F is a point x* £ T> such that 

F{x*) = x*. (2.2.1) 

• A singular point of the vector field f is a point x* £ T> such that 

fix*) = 0. (2.2.2) 

In both cases, x* is also called equilibrium point. Its orbit is simply {x*} and is called 
a stationary orbit. Note that a singular point of / is also a fixed point of the flow, and 
therefore sometimes abusively called a "fixed point of /" . 

We are now interested in the behaviour near an equilibrium point. In this section, we 
will always assume that / and F are twice continuously differentiable. If x* is a singular 
point of /, the change of variables x = x* + y leads to the equation 



y = f{x* + y) 

= ^y + g{y), 



(2.2.3) 
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where we have introduced the Jacobian matrix 

^=^(x^). (2.2.4) 

Taylor's formula implies that there exists a neighbourhood of and a constant M > 
such that 

\\g{y)\\ ^ M\\yf e Af. (2.2.5) 
Similarly, the change of variables Xk = x* + yj. transforms an iterated map into 

y.^. = F{x^ + y,)-x^ (2.2.6) 
= Byk + G{yk), 



where 

R = 

dx 



B = —{x*), \\G{y)\\^M\\yf Vy e Af. (2.2.7) 



2.2.1 Linear Case 

Let us start by analysing the equations (2.2.3) and ( 2.2.6| ) in the linear case, that is without 
the terms g{x) and G{x). Consider first the ODE 

y = Ay. (2.2.8) 

The solution can be written as 

y(t) = e^*y(0), (2.2.9) 
where the exponential of A is defined by the absolutely convergent series 

OO 

e^* = exp(yli) := ^ -A^. (2.2.10) 

fc=0 

In order to understand the behaviour of e"^*, let us recall some facts from linear algebra. 
We can write the characteristic polynomial of A as 

m 

ca(A) = det(A]l - A) = JJ(A - 0^)™^ (2.2.11) 

i=i 

where ai,...,am S C are distinct eigenvalues of A, and rrij are their algebraic multi- 
plicities. The geometric multiplicity gj of aj is defined as the number of independent 
eigenvectors associated with aj, and satisfies 1 ^ gj ^ mj. 

The results on decomposition of matrices leading to the Jordan canonical form can be 
formulated as follows [ HS74| . The matrix A can be decomposed as 

A = S + N, SN = NS. (2.2.12) 

Here S, the semisimple part, can be written as 

m 

S = ^ajPj, (2.2.13) 
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where the Pj are projectors on the eigenspaces of A, satisfying PjPk = ^jkPj, J2j Pj — ^ 
and rrij = dim(PjM'^). The nilpotent part N can be written as 



where the Nj satisfy the relations 

Np = 0, NjNk = for j / k, PjNk = N^Pj = Sj^Nj. 
In an appropriate basis, each Nj is block-diagonal, with gj blocks of the form 



/O 1 



In fact, Nj = unless gj < rrij. 

Lemma 2.2.2. With the above notations 



0\ 

1 

0/ 



m ^ 

e^* = y e"^* Pj (l + Njt + --- + 

j=i y 1 



{rrij - 1)! ^ 



(2.2.14) 



(2.2.15) 



(2.2.16) 



(2.2.17) 



Proof: We use the fact that e"^* e-^* = e^^^^-^)* whenever AB = BA, which can be checked 
by a direct calculation. Then e^* = e'^* e^* with 



-.St 



e^* = J]e^^* = ]l + ^(e^^*-l). 
The result follows from the facts that Pj{e^''^ — 1) = for j k, and that e^J* contains 



only finitely many terms, being nilpotent. 



□ 



The expression ( 2.2. 17| ) shows that the long-time behaviour is determined by the real 
parts of the eigenvalues aj, while the nilpotent terms, when present, influence the short 
time behaviour. This motivates the following terminology: 

Definition 2.2.3. The unstable, stable and center subspace of the singular point x* are 
defined, respectively, by 



S+:=P+M" = {y: lime'^*y = 0|, 
:=p-M" = |y: lim e^*2/ = 0|, 
E° := P°M", 



j:Reaj>0 
j:Reaj<0 

P0:= 5: P, 

j:Reaj=0 



(2.2.18) 



The sub spaces are invariant subspaces ofe^^, that is, e'^^ E^ C E~^ , e'^^ E C E and 
gAt ^0 ^ j^o _ rpf^^ fixed point is called 
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• a sink if E+ = E° = {0}, 

• a source if E" = E^ = {Q}, 

• a hyperbolic point if E^ = {0}, 

• an elliptic point if E'^ = E^ = {0}. 



Example 2.2.4. Let n = 2, and let A be in Jordan canonical form, with det^ 7^ 0. Then 
we can distinguish between the following behaviours, depending on the eigenvalues 01,02 
of ^ (see Fig. U). 

1. 01 / 02 

(a) If oi, 02 G M , then A = ( 0' ^° ) and 

At^f^"'' 0\ yi(t)=e'^i*yi(0) 
V q"^^) y2(0 =e"2*y2(o) 

The orbits are curves of the form y2 = cy"^^""^ . x* is called a node if 01O2 > 0, and 
a saddle if 0102 < 0. 

(b) Ifai=02 = o + ia;GC, then the real canonical form of ^ is A = ( 2 ) ^'^'^ 

At _ at f COS ujt — sin uit\ yi (t) = e^^ (yi (0) cos tut — 1/2(0) sin tot) 

ysiuLot coswt J 7/2 (i) = e"* (1/1(0) sin + 1/2(0) cos wt) 

X* is called a focus if o 7^ 0, and a center if o = 0. The orbits are spirals or ellipses. 

2. oi = 02 =: o 

(a) If a has geometric multiplicity 2, then A = ol and e"^* = e"* 1; x* is called a 
degenerate node. 

(b) If o has geometric multiplicity 1, then A= (g ^) and 

At_^atf'^ t\ _ yi(t) = e"*(yi(0)+y2(0)t) 



VO 1; ^ y2(t) = e«*y2(0) 
X* is called an improper node. 
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Let us now turn to the case of the hnear iterated map 

Vk+i = Byk (2.2.19) 

which admits the solution 

Vk = B'^yo. (2.2.20) 

Using a similar decomposition B = S + N into the semisimple and nilpotent part, we 
arrive at 

Lemma 2.2.5. Let hi he the eigenvalues of B, and Pi, Ni the associated projectors and 
nilpotent matrices. Then 



m min{fc,mi — 1} 
i=l j=0 

Proof: The main point is to observe that 



m min{fc,mi-l} , , 

B' = Ep^ E V'-'^/- (2-2-21) 

4—^ o— n / 



k 

B'' = {Y.^b,Pi + iV,)) = Y^^biPi + Ni 



i=l i=l 

because all cross-terms vanish. Then one applies the binomial formula. □ 
For large k, the behaviour of B'^ is dictated by the terms This leads to the 



following equivalent of Definition 2.2.5 : 



Definition 2.2.6. The unstable, stable and center subspace of the fixed point x* are 
defined, respectively, by 

S+:=P+M" = {y: lim B''y = 0}, P+ := V Pj, 

3--\bj\>l 

E- :=P-R'' = {y: lim B''y = 0}, P' := V P,-, (2.2.22) 

j:\b,\<l 

E°:=P°M", P°:= Pj. 

These subspaces are invariant under B. The remaining terminology on sinks, sources, 
hyperbolic and elliptic points is unchanged. 



Exercise 2.2. Find the equilibrium points of the standard map ( |1.2.1 ) and the Lorenz 



equations ( [L.3.9 ). Give the dimensions of their stable, unstable and center subspaces. 



Hint: To determine the sign of the real parts of the eigenvalues of a 3 x 3 matrix, one can 
apply the Viete formula to its characteristic polynomial. 
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2.2.2 Stability and Liapunov Functions 

Definition 2.2.7. Let x* be an equilibrium point of the system x = f{x). 

• X* is called stable if for any e > 0, one can find a 6 = 5{e) > such that whenever 
\\xq — x*\\ < 5, one has \\(pt{xQ) — < e for all t ^ 0. 

• X* is called asymptotically stable if it is stable, and there is a Sq > such that 
linit^oo ^t{xo) = X* for all xq such that \\xo — < 6o. 

• The basin of attraction of an asymptotically stable equilibrium x* is the set 

\xeV: liimptix) = X*}. (2.2.23) 

t—*oo 

• X* is called unstable if it is not stable. 

If X* is a fixed point of the map F, similar definitions hold with (pt{') replaced by -F^(-)- 

The linearization of the system x = f{x) around an equilibrium x* is the equation 
y = Ay with A = ^(x*). x* is called linearly stable if y = is a stable equilibrium of its 
linearization, and similarly in the asymptotically stable and unstable cases. Lemma [2.2.2 
shows that 

• X* is linearly asymptotically stable if and only if all eigenvalues of A have a strictly 
negative real part; 

• X* is linearly stable if and only if no eigenvalue of A has positive real part, and all 
purely imaginary eigenvalues have equal algebraic and geometric multiplicities. 

The problem is now to determine relations between linear and nonlinear stability. A useful 
method to do this is due to Liapunov. Here we will limit the discussion to differential 
equations, although similar results can be obtained for maps. 

Theorem 2.2.8 (Liapunov). Let x* be a singular point of f, let U be a neighbourhood 
of X* and set Uo:=U \ {x*}. Assume there exists a continuous function V : U ^ M, 
continuously differentiable on Uq, such that 

L V{x) > Vix*) for all x G Uq; 

2. the derivative of V along orbits is negative in Uq , that is, 

V(x):=-^V{ipt{x)) = Vy(x) • /(x) ^ yxGUo. (2.2.24) 
at t=o 

Then x* is stable. If, furthermore, 

3. the derivative of V along orbits is strictly negative, 

V{x) = Vy(x) • /(x) < Vx G Uq, (2.2.25) 
then X* is asymptotically stable. 

Proof: Pick e > small enough that the closed ball B{x*,e) with center x* and radius 
e, is contained in U. Let S = dB{x*,e) be the sphere of radius e centered in x*. S being 
compact, V admits a minimum on S, that we call /3. Consider the open set 

W = {xe E{x\e): V{x) < /3}. 

X* G W by Condition 1., and thus there exists 6 > such that the open ball B{x*,5) is 
contained in W. For any xq G B{x*,6), we have V{ipt{xQ)) < (3 for all t ^ 0, and thus 
iptixo) G W for alH ^ by Condition 2., which proves that x* is stable. 
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Figure 2.3. (a) Stable fixed point with level curves of a Liapunov function, (b) Asymp- 
totically stable fixed point, here the vector field must cross all level curves in the same 
direction, (c) Example of an unstable fixed point with the set W of Cetaev's Theorem. 



Assume now that ( p.2.251 ) holds. Since the positive orbit of xq G W is bounded, it 
admits a convergent subsequence {xn)n^o = {^t„ixo))n^o ^ y* £ W, tn oo. Consider 
the function t i— > V{(pt{xo)). It is continuously differentiable, monotonously decreasing, 
and admits a subsequence converging to V{y*). Thus V{ipt{xQ)) must converge to V{y*) 
as t ^ oo. Let 5 > be a small constant and define the compact set 

/C = {x G W: ^ V{x) ^ Viy") + 6}. 

If y* 7^ X*, then x* ^ /C, and thus the maximum of ^ on /C is a strictly negative constant 
c. Take n large enough that Xn E /C. Then (pt{xn) £ /C for all t ^ 0. But this implies that 
V{ipt{xn)) ^ V{xn) + ct which becomes smaller than V{y*) for t large enough, which is 
impossible. Thus y* = x*, and all orbits starting in W converge to x*. □ 



The interpretation of ( |2.2.24 ) is that the vector field crosses all level sets of V in the 
same direction (Fig. ^]^). V is called a Liapunov function for x*, and a strict Liapunov 
function if ( 2. 2. 251 ) holds. In fact, the proof also shows that if y is a strict Liapunov 
function on U, and W is a set of the form W = {x: V{x) < /3} contained in U, then W 
is contained in the basin of attraction of x*. Thus Liapunov functions can be used to 
estimate such basins of attraction. 

Exercise 2.3. Give sufficient conditions on the parameters of the Lorenz equations 1.3.S| for 
all orbits to converge to the point (0, 0, 0) (the origin is said to be globally asymptotically 
stable). Hint: Try Liapunov functions of the form V{X, Y, Z) = aX"^ + I5Y'^ + 7.^^, where 
a, /?, 7 > are constants. 

The advantage of the Liapunov method is that one does not need to solve the differ- 
ential equation. However, the method is not constructive, and the form of V has to be 
guessed in each case. In the linearly asymptotically stable case, such a V can always be 
constructed, which leads to the following result. 



Corollary 2.2.9. 

eigenvalues of A 
stable. 



Assume x* is a linearly asymptotically stable equilibrium, that is, all 
= ^{x*) have strictly negative real parts. Then x* is asymptotically 



Proof: There are many different constructions of strict Liapunov functions. We will give 
one of them. In order to satisfy Condition 1. of the theorem, we will look for a quadratic 
form 



V{x) = (x - X*) • Q{x - X*) 
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where Q is a symmetric, positive definite matrix. By assumption, there is a constant 
ao > such that Reaj ^ — ao for all eigenvalues ai of A. Thus Lemma 2.2.2 implies that 

l|e^*y|Kp(t)e-"«*||y|| Vy, 

where p is a polynomial of degree less than n. This implies that the function 

Vix)= / ||e^"(x-x*)f ds 
Jo 

exists. V{x) is of the above form with 

/•oo 

Jo 

Q is clearly symmetric, positive definite and bounded, thus there is a > such that 
IIQyII ^ -f^llyll for all y. Now we calculate the following expression in two different ways: 

roc J 

/ ^(e^^^e^^) ds = hm e^^*e^*-ll = -1 

foo J poo 

/ ^ (e^^^ e^^) ds = / {A^e""^' e^^ + e^"^^ e^^ A) ds = A^Q + QA. 
Jo ds Jo 

We have thus proved that 

A^Q + QA = -1. 

Now if y{t) = (pt{x) — X*, we have 

V = ^viM^)) = • Qyit)) = m ■ Qvit) + vit) ■ Qvit)- 

Inserting y = Ay + g(y) produces two terms. The first one is 

AyQy + y QAy = y ■ {A^Q + QA)y = -\\yf, 

and the second one gives 

9{y) -Qy + y Qoiv) = 2g{y) • Qy ^ 2||5(y)||||Qy|| ^ 2MK\\y\f. 

Hence V ^ + 2Mi^r||y|p, which shows that is a strict Liapunov function for 

||x — < ' result is proved. □ 

There exists a characterization of unstable equilibria based on similar ideas: 

Theorem 2.2.10 (Cetaev). Let x* be a singular point of f , U a neighbourhood of x* 
and Uq = U \ {x*}. Assume there exists an open set W, containing x* in its closure, 
and a continuous function V : U ^ M , which is continuously differentiable on Uq and 
satisfies 

L V{x) > for all x eUoH W; 

2. V{x) > for all xGUoH W; 

3. V{x) = for all xeUoH dW. 
Then x* is unstable. 
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Proof: First observe that the definition of an unstable point can be stated as fohows: 
there exists e > such that, for any 5 > 0, one can find xq with ||xo — < 5 and T > 
such that ||9Jr(a3o) — ^ ^• 

Now take e > sufficiently smah that B{x*, e) C U. For any 6 > 0, B{x*, 5) n W / 0. 
We can thus take an xq GUqCiW such that ||xo — x*|| < 6, and by Condition 1. V{xq) > 0. 
Now assume by contradiction that ||(/?t(xo) — < e for all t ^ 0. fti^o) niust stay in 
Uq nW for all t, because it cannot reach the boundary of W where V = 0. Thus there 
exists a sequence x„ = ipt„{xo) converging to some xi £ Uq U W. But this contradicts 
the fact that V{xi) > 0, as in the proof of Theorem 2.2.8 , and thus ||(/7t(xo) — x*|| must 
become larger than e. □ 



Corollary 2.2.11. Assume x* is an equilibrium point such that A = ^{x*) has at least 
one eigenvalue with positive real part. Then x* is unstable. 

Proof: Consider first the case of A having no purely imaginary eigenvalues. We can 
choose a coordinate system along the unstable and stable subspaces of x*, in which the 
dynamics is described by the equation 

y+ = A+y+ + g+{y) 

y- = ^~y- + g-{y), 

where all eigenvalues of A^ have a strictly positive real part, all eigenvalues of A^ have 
a strictly negative real part, y = [yj^^yS) and the terms g± are bounded in norm by a 
positive constant M times We can define the matrices 

/■oo roo 

Q = e^-^e^-Ms, Q+= e"^?^ e-^+^ ds, 
Jo Jo 

which are bounded, symmetric, positive definite, and satisfy A^Q- + Q-A- = —1 and 
A^Q^ + Q+A^ = 1. Define the quadratic form 

y{y) = y+ ■ Q+y+ - y- ■ Q-y-- 

The cone W = {y: V{y) > 0} is non-empty, because it contains an eigenvector of A 
corresponding to an eigenvalue with positive real part. Proceeding similarly as in the 
proof of Corollary 2.2.9, we find 

Viy) = + 2g+{y) ■ Q+y+ + - 2g^{y) ■ Q^y^ 

^ \\yf - 2KM\\yf. 

Thus Cetaev's theorem can be applied to show that x* is unstable. If A also has purely 
imaginary eigenvalues, we obtain the additional equation 

2/0 = ^oyo + 9o{y), 

where all eigenvalues of Aq are purely imaginary. Let S be an invertible complex matrix 
of the same dimension as and consider the function 

v{y) = y+ ■ Q+y+ - y- ■ Q-y- - \\Syof, 
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where u ■ v = ^ UiVi for complex vectors u, v. Proceeding as above, we obtain that 



Viy) ^ \\y+f + \\y. 



2KM\\yfi\\y+\\ + \\y^ 



-2ReiSyo ■ AoSyo) - 2Re{Sgoiy) ■ Syo)- 

We shall prove below that for any e > 0, one can construct a matrix 5(e) such that 
Re(S'yo • ^O'S'yo) ^ ^ll-^yoP- We now take U = {y: \\y\\ < 6}, where 5 > has to be 
determined, and W = {y: V{y) > 0}. If y € W, we have 

Re(5yo • AoSyo) ^ e\\Syof < ey+ • Q+Y+ < eK\\y+f. 

We introduce the constants 

ll'S'yoll ||yo|' 



C{e) 



sup 

yoj^O \\yo\ 



c{e) 



sup 



Then we have 



Re(5ffo(y) • Syo) ^ C\\go{y)\\\\Syo\\ ^ CMK'/^yf\\y, 



+ + c'WSyof < (1 + c'm\y+f + \\y_f). 



Putting everything together, we obtain for all y £U CiW 



Viy) > {1 - eK){\\y+f + \\y^\ 



+ \\y~\ 



\^) - 2KM\\yf[{l + CK-'/^)U 
> {\\y+f + \\y-f) [1-eK- 2KM{1 + c{e)^K){2 + C{e)K-'^/^)6] . 

Taking e < 1 / K"^ and then 5 small enough, we can guarantee that this quantity is positive 
for all y G ^0 n W, and the corollary is proved. □ 

In the proof we have used the following result. 

Lemma 2.2.12. Assume all the eigenvalues of the mxm matrix Aq are purely imaginary. 
For every e > 0, there exists a complex invertible matrix S such that 

\ReiSz- SAoz)\i^e\\Sz\\'^ VzgC'". (2.2.26) 

Proof: Let 5*0 be such that B = S'o^O'S'o^^ is in complex Jordan canonical form, that 
is, the diagonal elements bjj = iXj of B are purely imaginary, = crj is either zero 

or one, and all other elements of B are zero. Let Si be the diagonal matrix with entries 
l,e-\...,e^-™. Then 

/iAi eo"! 



C := SiBS^ 

Let S = SiSq and u = Sz. Then 
Sz ■ SAqz 



\ 



i Am 



Re- 



\Sz\\ 





u ■ Cu 











Re 



V 



^ e 



El^jll%+il 



where we used the fact that the upper sum has m—1 terms and the lower one m terms. □ 

The two corollaries of this section can be stated as follows: if x* is a hyperbolic 
equilibrium, then it has the same type of stability as the linearized system. The same 
properties are valid for maps (see Table 2.1). This is in general not true for non-hyperbolic 
equilibria. This situation will be studied in more detail in Chapter 3. 
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ODE ± = f{x) 


Map Xk+i = Fixk) 


Conservative 
Dissipativc 


v-/ = o 

V-/<0 


|det|||=l 
|det|||<l 


Equilibrium 


fix*) = 


Fix*) = X* 


Asympt. stable if 
Unstable if 


Re Oj < Vi 
3i : Reaj > 


\hi\ < 1 Vi 
3i : \hi\ > 1 



Table 2.1. Comparison of some properties of ordinary differential equations and iterated 
maps. Here and hi are eigenvalues of the matrices A = and B = ^{x*). 



2.2.3 Invariant Manifolds 

For hyperbolic equilibrium points, the analogies between nonlinear and linear systems can 
be pushed further. One of them has to do with invariant manifolds, which generalize the 
invariant subspaces of the linear case. We assume in this section that / is of class with 
r ^ 2. 

Definition 2.2.13. Let x* be a singular point of the system x = fix), and let U be a 
neighbourhood of x*. The local stable and unstable manifolds of x* in U are defined, 
respectively, by 

W^^ix*) --{x eU: lim iptix) = x* and ipt{x) G W Vt ^ 0} 

(2 2 27) 

■.={x eU: lim iptix) = x* and iptix) G W Vi ^ O}. v • • ; 

t—>—(yo 

The global stable and unstable manifolds of are defined by 

W^{x*) = [j^t{WUx*)), 

W^{x*) = U MWil^ix*)). 

Similar definitions can be made for maps. Global invariant manifolds can have a 
very complicated structure, and may return infinitely often to a neighbourhood of the 
equilibrium point. This is why one prefers to define separately local and global invari- 
ant manifolds. The following theorem states that local invariant manifolds have a nice 
structure. 

Theorem 2.2.14 (Stable manifold theorem). Let x* be a hyperbolic equilibrium point 
of the system x = fix), such that the matrix §^(a^*) has n+ eigenvalues with positive real 
parts and n_ eigenvalues with negative real parts, with n+,n_ ^ 1. Then x* admits, in a 
neighbourhood U, 

• a local stable manifold Wf^^ix*), which is a dijferentiable manifold of class C and 
dimension n_, tangent to the stable subspace E~ at x* , and which can be represented 
as a graph; 

• a local unstable manifold W^^ix*), which is a differentiable manifold of class C and 
dimension n+, tangent to the unstable subspace E'^ at x*, and which can be represented 
as a graph. 



(2.2.28) 
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Figure 2.4. Orbits near a hyperbolic fixed point: (a) orbits of the hnearized system, (b) 
orbits of the nonhnear system with local stable and unstable manifolds. 



We will omit the proof of this result, but we will give in Chapter 3 the proof of the center 
manifold theorem, which relies on similar ideas. Let us now explain a bit more precisely 



what this result means. The geometric interpretation is shown in Fig. 2.4. To explain 



the meaning of "a difFerentiable manifold of class C" tangent to and representable 
as a graph", let us introduce a coordinate system along the invariant subspaces of the 
linearization. The vector field near x* can be written as 



y+ = A+y+ + g+{y+,y-) 

y- = -4_y_ +g-{y+,y-), 



(2.2.29) 



where is a n+ x n+ matrix, which has only eigenvalues with positive real parts, and 
A- is a n_ x n_ matrix, which has only eigenvalues with negative real parts. The terms 
g± are nonlinear and satisfy ||fi'±(y+, ^ -^ll2/|P i^i ^) where M is a positive constant. 
The theorem implies the existence of a function of class 



h'\0) = 0, 



dy+ 



(0) = 0, 



(2.2.30) 



where is a neighbourhood of the origin in 
is given by the equation 



y- 



such that the local unstable manifold 



(2.2.31) 



Similar relations hold for the stable manifold. 

In order to determine the function h^, let us compute y- in two ways, for a given orbit 
on the unstable manifold: 



y- 
y- 



A^h-iy+)+g^iy+,h-iy+)) 



dy+ 



{y+)y^ 



dy^ 



(y+) A+y+ + g+{y+,K'{y+)) 



(2.2.32) 



Since both expressions must be equal, we obtain that /i" must satisfy the partial differential 
equation 



A_h-{y^)+g_{y^,h^{y+)) 



dy^ 



(y+) A+y++g+{y+,h}'{y+)) 



(2.2.33) 



This equation is difficult to solve in general. However, since we know by the theorem that 
is of class C^, we can compute /i" perturbatively, by inserting its Taylor expansion into 



( 2.2.33 ) and solving order by order. 
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Example 2.2.15. Consider, for n = 2, the system 

m = 2/1 

m = -y2 + yl- 



(2.2.34) 



Then the equation ( 2.2.33 ) reduces to 

-/i"(2/i)+y2 = /i"'(y,)y,, (2.2.35) 



which admits the solution 



3 

This is confirmed by the explicit solution of ( ^.2.34| ) 

yi(t) = yi(0)e* 



^"(yi) = \yl (2.2.36) 



y2{t) = (2/2(0) - -yi(0)2) e-* +-yi(0)2 ^. 
2.2.4 Normal Forms 

In this section we will examine some further connections between the flow near an equilib- 
rium point and its linearization. We will assume that x* is a singular point of the system 
X = f{x), and that / is of class C, r ^ 2, in a neighbourhood of x*. 

Definition 2.2.16. Let U and W he open sets in M", and let f : U ^ W and g : W ^ 

M" 6e two vector fields of class C . These vector fields are called 

• topologically equivalent if there exists a homeomorphism h : U ^ W taking the orbits 
of X = f{x) to the orbits of y = g{y) and preserving the sense of time; 

• differentiably equivalent if there exists a diffeomorphism /i : — > W taking the orbits 
of X = f{x) to the orbits of y = g{y) and preserving the sense of time. 

If, in addition, h preserves parametrization of the orbits by time, the vector fields are called 
conjugate. 

Equivalence means that if ift and ipt are the flows of the two systems, then 

ipt o h = h o ^r{t) (2.2.38) 

on U, where r is a homeomorphism from M to M . If r(t) = t for all t, the systems are 
conjugate. 

Theorem 2.2.17 (Hartman-Grobman). Let x* be a hyperbolic equilibrium point of 



X = f{x), that is, the matrix A = ^{x*) has no eigenvalue with zero real part. Then, 
a sufficiently small neighbourhood of x* , f is topologically conjugate to the linearization 
y = Ay. 

Note, however, that topological equivalence is not a very strong property, since h 
need not be differentiable. In fact, one can show that all linear systems with the same 
number of eigenvalues with positive and negative real parts are topologically equivalent 



m 



(see for instance | HK91 |). So for instance, the node and focus in Fig. are topologically 
equivalent. On the other hand, differentiable equivalence is harder to achieve as shows the 
following example. 
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Example 2.2.18. Consider the following vector field and its linearization: 

yi = 2yi + yl zi = 2zi 

2/2 = 7/2 Z2 = Z2. (2.2.39) 

The orbits can be found by solving the differential equations 

-T— = ^ h 2/2, — = 2— , (2.2.40) 

dy2 y2 dZ2 Z2 

which admit the solutions 

yi= [c + log\y2\]yl zi = cz|. (2.2.41) 

Because of the logarithm, the two flows are C^- but not C^-conjugate. 

The theory of normal forms allows to explain these phenomena, and to obtain condi- 
tions for the existence of such C-conjugacies. Consider the system for y = a; — x*, 

y = Ay + g{y). (2.2.42) 

We can try to simplify the nonlinear term by a change of coordinates y = z + h(z), which 
leads to 

dh 

z + = Az + Ah{z) + g{z + h{z)). (2.2.43) 

Assume that h{z) solves the partial differential equation 

dh 

^{z)Az-Ah{z)=g{z + hiz)). (2.2.44) 
oz 

Then we obtain for z the linear equation 

i = Az. (2.2.45) 

Unfortunately, we do not know how to solve the equation ( p. 2. 44 ) in general. One can, 
however, work with Taylor series. To this end, we rewrite the system ( p.2.42| ) as 

y = Ay + g2{y) + gM + ■■■ + 9r-i{y) + 0{\\yf). (2.2.46) 

Here the last term is bounded in norm by a constant times ||y||^ , and the terms gk{y) are 
homogeneous polynomial maps of degree k from M" to M" {gk{>^y) = X^Qkiv) VA e M). 
Let us denote by TLk the set of all such maps. Jik is a vector space for the usual addition 
and multiplication by scalars. For instance, when n = 2, 7i2 admits the basis vectors 

We now define a linear map from TCk to itself given by 

adfc A : Hk ^ Hk 

dh (2.2.48) 

Ky) ^ —{y)Ay-Ah{y). 

The fundamental result of normal form theory is the following: 
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Proposition 2.2.19. For each k, 2 ^ k < r, choose a complementary space Qt of the 
image o/ad^ A, that is, such that ^^©adfc A(J-Lk) = TCk- Then there exists, in a neighbour- 
hood of the origin, an analytic (polynomial) change of variables y = z + h(z) transforming 
(|2.2.46|) into 

z = Az + gTiz) + gTiz) + • • • + gfl^{z) + 0{\W), (2.2.49) 
where g^^^ G Qk, 2 ^ k < r. 

Proof: The proof proceeds by induction. Assume tliat for some k, 2 ^ k ^ r — 1, we 
liave obtained an equation of the form 

k~l 

y = Ay + ^gr(.y) + 9k{y) + 0(||2/f 
i=2 

We decompose the term gk{y) into a resonant and a non-resonant part, 

9k{y)=9r{y) + gl{y). 5^Gad,A(W,), gTeQu- 
There exists hk G "Hk satisfying 

dh 

&dkA{hk{z)) := -Q^{z)Az - Ahk{z) = gl{z). 

Observe that gY^{z + hk{z)) = gY^{z) + C'(||z||*^^"'^) for all j, and a similar relation holds 
for gk- Thus the change of variables y = z + h{z) yields the equation 



1 + ^{z)] i = Az + Ahkiz) + ^ g^'iz) + gk{z) + 0{ 



IzW^^'] 



i=2 

k 



l + ^{z)]Az + ^gY^{z) + 0{\\zf+'), 
i=2 



where we have used the definition of h to get the second line. Now for sufficiently small z, 
the matrix 1 + admits an inverse 1 + OdlzH*^""^). Multiplying the above identity on 
the left by this inverse, we have proved the induction step. □ 

The terms g'k'^iz) are called resonant and ( p.2.49| ) is called the normal form of (2.2.46). 
The equation adk A{hk{z)) = g^{z) that has to be satisfied to eliminate the non-resonant 
terms of order k is called the homological equation. Whether a term is resonant or not is a 
problem of linear algebra, which depends only on the matrix A. While it can be difficult 
to determine the coefficients of the resonant terms in a particular case, it is in general 
quite easy to find which terms can be eliminated. In particular, the following result holds: 

Lemma 2.2.20. Let (ai,...,a„) be the eigenvalues of A, counting multiplicity. Assume 
that for each j, 1 ^ j ^ n, we have 

Pitti H h PnO-n + aj (2.2.50) 

for all n-tuples of non-negative integers (pi, . . . ,Pn) satisfying Pi + ■ ■ ■ + Pn = k- Then 
adk A is invertible, and thus there are no resonant terms of order k. 
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Proof: We can assume that A is in Jordan canonical form. Consider first the case of a 
diagonal A. Let (ei, . . . ,en) be the canonical basis of M". For TCk we choose the basis 
vectors z^^ . . . Zn^ej, where pi + ■ ■ ■ + pn = k. Then an explicit calculation shows that 

adfc A{z^^ . . . zP"ej) = (pioi H h PnO-n - ajO^i' • • • z^"ej- 

By assumption, the term in brackets is different from zero. Thus the linear operator ad^ A 
is diagonal in the chosen basis, with nonzero elements on the diagonal, which shows that 
it is invertible. 

Consider now the case of a matrix A that is not diagonal, but has elements of the 
form djj+i = 1. Then ad^ A applied to a basis vector will contain additional, off-diagonal 
terms. One of them is proportional to z^^ . . . Zn"ej-i, while the others are of the form 
Zk+idzkizi^ . . . Zn")ej. One can show that the basis vector of Tik can be ordered in such a 
way that ad^ A is represented by a triangular matrix, with the same diagonal elements as 
in the case of a diagonal A, thus the conclusion is unchanged. □ 



The non-resonance condition ( 2.2.50D is called a Diophantine condition, since it involves 



integer coefficients. Thus resonant terms can exist only when the eigenvalues of A satisfy a 
relation of the form piai + • • • +PnO-n = o-j , which is called a resonance of order pi -t~Pn* 



In Example 2.2.15, the relation 2a2 = ai induces a resonance of order 2, which makes it 
impossible to eliminate the term by a polynomial change of coordinates. 

In order to solve the question of differentiable equivalence, the really difficult problem is 



to eliminate the remainder C'(||z||'') in the normal form (2.2.49). This problem was solved 
by Poincare for sources and sinks, and by Sternberg and Chen for general hyperbolic 
equilibria (see for instance [IIar64| ] ) ■ We state here the main result without proof. 

Theorem 2.2.21 (Poincare-Sternberg-Chen). Let A be anxn matrix with no eigen- 
values on the imaginary axis. Consider the two equations 

x = Ax + bi(x) ^ ^ 

(2.2.51) 

y = Ay + b2[y). 

We assume that hi and 62 o^re of class , r ^ 2, in a neighbourhood of the origin, that 
bi{x) = Odlxf ), b2{x) = Odlxf), and bi{x) - b2{x) = 0{\\xf). Then for every k ^ 2, 
there is an integer N = N{k, n,A) ^ k such that, if r ^ N , there exists a map h of class 
such that the two systems can be transformed into one another by the transformation 
x = y + h{y). 

This result implies that for the system ij = Ay + g{y) to be C'^-conjugate to its lin- 
earization z = Az, it must be sufficiently smooth and satisfy non-resonance conditions 
up to sufficiently high order A^, where this order and the conditions depend only on k, 
n and the eigenvalues of A. In the special case of all eigenvalues of A having real parts 
with the same sign (source or sink), Poincare showed that N = k. For general hyperbolic 
equilibria, can be much larger than k. 

Another, even more important consequence, is that vector fields near singular points 
can be classified by their normal forms, each normal form being a representative of an 
equivalence class (with respect to C'^-conjugacy). This property plays an important role 
in bifurcation theory, as we shall see in Chapter 3. 

Let us finally remark that in the much more difficult case of non-hyperbolic equilibria, 
certain results on C'^-conjugacy have been obtained by Siegel, Moser, Takens and others. 
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2.3 Periodic Solutions 
2.3.1 Periodic Orbits of Maps 

Definition 2.3.1. Let p ^ 1 be an integer. A periodic orbit of period p of the map F is 

a set of points {x^, . . . , x*} such that 

F{xi) = xi ... F{x;_^) = x;, F{x;) = xi (2.3.1) 

Each point of the orbit is called a periodic point of period p. Thus a periodic point x* of 
period p is also a fixed point of F^. p is called the least period of x* if F^{x*) / x* for 
l^j<p. 

To find periodic orbits of an iterated map, it is tiius sufficient to find tiie fixed points of 
FP, p = 1,2, ... . Unfortunately, this becomes usually extremely difficult with increasing 
p. Moreover, the number of periodic orbits of period p often grows very quickly with p. 
Methods that simplify the search for periodic orbits are known for special classes of maps. 
For instance, for two-dimensional conservative maps, there exists a variational method: 
periodic orbits of period p correspond to stationary points of some function of M ^ to R . 

Once a periodic orbit has been found, the problem of its linear stability is rather easily 
solved. Indeed, it is sufficient to find the eigenvalues of the matrix 

dF, ^ BF, ^ ^ dF ^ ' 



Note that the result has to be invariant under cyclic permutations of the matrices. 

The dynamics near any point of the periodic orbit can be inferred from the dynamics 
near one of them, considered as a fixed point of F^. Thus periodic orbits can also be 
classified into sinks, sources, hyperbolic and elliptic orbits, and the concepts of nonlinear 
stability, invariant manifolds and normal forms can be carried over from fixed points to 
periodic orbits. 



2.3.2 Periodic Orbits of Flows and Poincare Sections 

Definition 2.3.2. Let f be a vector field, ipt its flow and T > a constant. A periodic 
solution of period T of f is a function 7(t) such that 

W) = fhit)) and 7(t + T) = ^{t) Vt. (2.3.3) 

The corresponding closed curve F = {'jit) : ^ t ^ T} is called a periodic orbit of period 
T. Thus each point x of this orbit is a fixed point of (fx. T is called the least period of 
the orbit if (pt{x) ^ x for <t <T. 

Finding periodic orbits of differential equations is even more difficult than for maps. 
There exist methods which help to find periodic orbits in a number of particular cases, 
such as two-dimensional flows, or systems admitting constants of the motion and small 
perturbations of them. 

Let us now assume that we have found a periodic solution j{t). We would like to 
discuss its stability. The difference y{t) = x(t) — ^{t) between an arbitrary solution and 
the periodic solution satisfies the equation 



y = f{i{t) + y)-f{i{t)). 



(2.3.4) 
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If / is twice continuously differentiable and y is small, we may expand / into Taylor series, 
which yields 

df 

y = A{t)y + g{y,t), A{t) = -^{j{t)), \\g{y,t)\\ ^ M\\yf . (2.3.5) 

Let us examine the linearization of this equation, given by 

y = A{t)y. (2.3.6) 

Note that a similar equation already appeared in the proof of Proposition 2.1.10. This 
equation admits a unique global solution, which can be represented, because of linearity, 
as 

y{t) = U{t)y{0), (2.3.7) 

where U{t) is an n x n matrix- valued function solving the equation 

U{t) = A{t)U{t), C/(0) = 1. (2.3.8) 

The function U (t) is called the principal solution of the equation ( 2.3.6 ). It should be clear 
that the linear stability of T is related to the asymptotic behaviour of the eigenvalues of 
U{t). Unfortunately, there is no general method to determine these eigenvalues. Note, 
however, that A{t) is periodic in t, and in this case we can say more. 

Theorem 2.3.3 (Floquet). Let A{t) = A{t + T) for all t. Then the principal solution 
of y = A{t)y can be written as 

U{t) = P{t)e^', (2.3.9) 

where P{t + T) = P{t) for all t, P(0) = 1, and B is a constant matrix. 

Proof: The matrix V{t) = U{t + T) satisfies the equation 

V{t) = U{t + T) = A{t + T)U{t + T) = A{t)V{t), 

which is the same as ( |2.3.8| ), except for the initial value V^(0) = U{T). We already saw 
in Proposition 2.1.10| that detU{t) for all t. Thus the matrix V{t)U{T)~^ exists and 
satisfies ( p. 3. 8] ) , including the initial condition. By uniqueness of the solution, it must be 
equal to U (t) : 

V{t)U{T)-'^ = U{t) U{t + T) = U{t)U{T). 

We claim that there exists a matrix B such that U{T) = e^^. To see this, let Aj 7^ 
and mi, i = 1, . . . ,m he the eigenvalues of U{T) and their algebraic multiplicities. Let 
U{T) = Y^T^ii^i-^i + ^i) be the decomposition of U{T) into its semisimple and nilpotent 
parts. Then, using Lemma |2.2.2 , it is easy to check that 

..ii:(M.m-Ei-f) 

i=i ^ j=i 3\ / 

satisfies e^'^ = U{T). Here the sum over j is simply the Taylor expansion of log(]l-|-A^i/Ai). 
B is unique up to the determination of the logarithms. We now define 



P{t) = U{t)e 
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Figure 2.5. Definition of the Poincare map associated with the periodic orbit 7(t). 



Then we have for all t 

P{t + T) = U{t + T) e-^(*+^) = U{t) e^^ e-^(*+^) = P{t). 
Fmally, P(0) = f/(0) = 1, which completes the proof. 



Floquet's theorem shows that the solution of ( 2.3.6| ) can be written as 

y(t) = P(t)e^*y(0). 



□ 



(2.3.10) 



Since P{t) is periodic, the long-time behaviour depends only on B. The eigenvalues of 



B are called the characteristic exponents of the equation, e is called the monodromy 
matrix, and its eigenvalues, called the characteristic multipliers, are exponentials of the 
characteristic exponents times T. Computing the characteristic exponents is difficult in 



general, but the existence of the representation ( 2.3.10 ) is already useful to classify the 
possible behaviours near a periodic orbit. 

Exercise 2.4- Consider the Hill equation 



-uj{tfx, Uj{t) 



Vl ioi nT <t < {n+\)T 

1 for {n + \)T <t<{n+ l)T 



Vn G Z, 



where T,Vl are positive parameters. Write this system in the form ( 2.3.6| ), and compute 
the monodromy matrix and the characteristic exponents. Plot the exponents as a function 
of VL for T = TT. Hint: The eigenvalues of a 2 x 2 matrix can be expressed as a function of 
its determinant and its trace. 

Once we have determined the linear stability of the periodic orbit, we could proceed 
in a similar way as in the case of a stationary point, in order to determine the nonlinear 
stability, the existence of invariant manifolds, and similar properties. However, Poincare 
invented a remarkable method, which allows to shortcut all these steps by reducing the 
problem to a simpler one, which has already been studied. Appropriately enough, this 
method is called the Poincare section. 

Definition 2.3.4. Let j{t) be a periodic solution of period T, xq = j{0), and let Ti be a 

hyperplane transverse to the orbit at xq (see Fig. \2.3^ ). By continuity of the flow, there is 
a neighbourhood U of xq in S such that for all x = xq + y £ U , we can define a continuous 
map T{y), r(0) = T, such that ftix) returns for the first time to Ti in a vicinity of xq at 
t = T{y). The Poincare map H associated with the periodic orbit is defined by 



xo + n(y) ■.= (p^(^y){xo + y). 



(2.3.11) 
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Proposition 2.3.5. The Poincare map is as smooth as the vector field in a neighbourhood 
of the origin. The characteristic multipliers of the periodic orbit are given by 1 and the 
n — 1 eigenvalues of the Jacobian matrix ^(0). 

Proof: The smoothness of 11 fohows directly from the smoothness of the flow and the 
implicit function theorem. Let us now observe that 

^7(i) = ^/(tW) = (7W)7(t) = A{t)j{t). 
Thus by Floquet's theorem, we can write 

7(t)=P(t)e^*7(0), 

and, in particular, 

7(0) =7(r) =P(T)e^^7(0) = e^^7(0). 

This shows that 7(0) is an eigenvector of e^'^ with eigenvalue 1. Let (ei, . . . , e„_i, 7(0)), 
ei, . . . ,en-i G S, be a basis of M". In this basis. 



where B-£ is the restriction of B to S, and the dots denote arbitrary entries. Now, if we 



consider momentarily 7/ as a vector in instead of E, linearization of (2.3.11) gives 



The first term is a matrix with zero entries except on the last line, so that 5^11(0) has the 
same representation as e^^, save for the entries marked by dots. In particular, when y is 
restricted to S, ^(0) has the same eigenvalues as e^^^. □ 

The consequence of this result is that, by studying the Poincare map, we obtain a 
complete characterization of the dynamics in a neighbourhood of the periodic orbit. In 
particular, if y = 0, considered as a fixed point of the Poincare map, admits invariant 
manifolds, they can be interpreted as the intersection of S and invariant manifolds of the 
periodic orbit. 
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Chapter 3 

Local Bifurcations 



Up to now, we have obtained quite a precise picture of the dynamics near hyperbohc 
equihbrium solutions. One might wonder whether it is of any interest to examine the 
case of nonhypcrboUc cquihbria, since a matrix chosen at random will have eigenvalues on 
the imaginary axis with probability zero. This argument no longer works, however, if the 
dynamical system depends on a parameter: 

x = f{x,X) or Xfe+i = F(xfc, A), (3.0.1) 

where A G R (or M^). By changing A, it is quite possible to encounter nonhyperbolic 
equilibria. 

An important result in this connection is the implicit function theorem: 

Theorem 3.0.1. Let M be a neighbourhood of{x*,y*) in x M"". Let f : J\f ^ R"^ be 

of class C, r ^ 1, and satisfy 

f{x*,y*) = 0, (3.0.2) 

det^{x*,y*)^0. (3.0.3) 

Then there exists a neighbourhood U of y* in R and a unique function cp : 14 ^ of 
class C such that 

f{y*) = X*, (3.0.4) 
f{^{y),y) = for all ye U. (3.0.5) 

This result tells us under which conditions the equation f{x, y) = "can be solved with 
respect to x" . Assume x* is an equilibrium point of f{x, Aq) and let A be the linearization 
^(x*, Aq). Then the following situations can occur: 

• If ^4 has no eigenvalues with zero real part, then / will admit equilibrium points x*(A) 
for all A in a neighbourhood of Aq. By continuity of the eigenvalues of a matrix- 
valued function, x*{X) will be hyperbolic near Aq. The curve x*{X) is usually called 
an equilibrium branch of /. 

• If A has one or several eigenvalues equal to zero, then the implicit function theorem 
can no longer be applied, and various interesting phenomena can occur. For instance, 
the number of equilibrium points of / may change at A = Aq. Such a situation is called 
a bifurcation, and (x*, Aq) is called a bifurcation point of /. 
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• If A has purely imaginary, nonzero eigenvalues, the implicit function theorem can still 
be applied to show the existence of an equilibrium branch x*{X), but its stability may 
change at A = Aq- This situation is also called a bifurcation. 

Let us point out that we consider here local bifurcations, that is, changes of the orbit 
structure in a small neighbourhood of equilibria. We will not discuss in any depth global 
bifurcations, which involve simultaneous changes in a larger region of phase space. 



3.1 Center Manifolds 

3.1.1 Existence of Center Manifolds 

One of the most useful methods to study the flow near a bifurcation point is the center 
manifold theorem, which generalizes the stable manifold theorem (Theorem 2.2.14) to 
nonhyperbolic equilibrium points. 

Definition 3.1.1. Let lA C M" be an open set. Let 5 C M" have the structure of a 
differentiable manifold. For x €z U, let (ti,^!) ^ be the maximal interval such that 
^t{x) G U for all t G (tf,tf). S is called a local invariant manifold if ipt{x) G S for all 
X eSnU and all t e (tf,tf). 



Theorem 3.1.2. Let x* be a singular point of f , where f is of class , r ^ 2, in a 
neighbourhood of x* . Let A = ^{x*) have, respectively, n+, no and n_ eigenvalues with 
positive, zero and negative real parts, where no > 0. Then there exist, in a neighbourhood 
of X* , local invariant manifolds W^^, W^^^ and W^^^, of respective dimension n+, no 
and n_, and such that 

• is the unique local invariant manifold tangent to at x* , and ftix) — > x* as 
t — oo for all X G W^^. 

• ^loc unique local invariant manifold tangent to E- at x* , and (pt{x) — > x* as 
t ^ oo for all X G W[^^ . 

• VFiqj, is tangent to Eq, but not necessarily unique. 

Before giving a (partial) proof of this result, we shall introduce a useful lemma from 
the theory of differential inequalities. 

Lemma 3.1.3 (Gronwall's inequality). Let ip, a and (3 be continuous and real-valued 
on [a,b], with [j non-negative, and assume that 

ip{t) a{t) + f f3{s)ip{s)ds yt£[a,b]. (3.1.1) 

J a 

Then 

(^(t) ^ a(t) + / /3(s)a(s)e^»^(")'^"ds VtG[a,&]. (3.1.2) 

J a 

Proof: Let 



R{t) = j (3{s)^{s)ds. 

J a 
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Then ip{t) ^ a{t) + R{t) for all t G [a, b] and, since /3{t) ^ 0, 

^(t) = PitMt) ^ P{t)a{t) + P{t)R{t). 
at 

Let K{s) = /3(n) du. Then 

Ae'^^')R{s) = \R'{s)-Pis)R{s)] e'^^'^ ^ /3(s)q(s) e'^^^) 
ds '- -' 

and thus, integrating from a to t, 

e-^(*)i?(t)^ f P{s)ais)e~^'^'^ds. 

J a 

We obtain the conclusion by multiplying this expression by e^*-*^ and inserting the result 
into (I3.1.1D . □ 

There exist various generalizations of this result, for instance to functions (3{t) that 
are only integrable. 

Let us now proceed to the proof of the center manifold theorem. There exist more 
or less sophisticated proofs. We will give here a rather straightforward one taken from 
[ Ca81 ]. For simplicity, we consider the case n_|_ = 0, and we will only prove the existence 
of a Lipschitz continuous center manifold. 

Proof of Theorem p.l.2| . We write the system near the equilibrium point as 

y = By + g-{y,z) 
z = Cz + go{y,z), 

where all eigenvalues of B have strictly negative real parts, all eigenvalues of C have 
zero real parts, and 2;)||, ||(7o(y, ^;)|| ^ M(||7/|p + \\z\\'^) in a neighbourhood of the 

origin. We shall prove the existence of a local center manifold for a modified equation, 
that agrees with the present equation in a small neighbourhood of the equilibrium. Let 
: — > [0, 1] be a C°° function such that 'ip{x) = 1 when ||x|| ^ 1 and ^(x) = when 
||x|| ^ 2. We introduce the functions 

z z 
G-{y,z) = g^{y,z'tp{-)), Go{y,z) = go{y, zxp{-)) , 



Then the system 



y = By + G-{y,z) 
z = Cz + Go(y,z), 



agrees with the original system for ||2;|| ^ e. We look for a center manifold with equation 
y = h{z), where /i is in a well-chosen function space, in which we want to apply Banach's 
fixed point theorem. Let p > and k > be constants, and let X be the set of Lipschitz 
continuous functions /i : R"" ^ M"" with Lipschitz constant k, ^ p for all z G M"" 

and h{0) = 0. X is a complete space with the supremum norm |-|. 

For h £ X, we denote by (pt{-, h) the flow of the differential equation 



i = Cz + Go{h{z),z). 



42 



CHAPTER 3. LOCAL BIFURCATIONS 



For any solution {y{s), z{s))tQ^s!S,t, the relation 

y{t) = e^(*-*») y{to) + f e^(*-^) G_ {y{s), z{s)) ds 
J to 

is satisfied, as is easily checked by differentiation. Among all possible solutions, we want 
to select a class of solutions that are tangent to the center subspace y = at the origin. 
In the linear case, the above solutions satisfy this property only if e~^*" y(to) = 0. We 
will thus consider the class of particular solutions satisfying 

y{t)= f e^(*-«)G_(2/(s),z(s))d5 

J — oo 

If we set t = and require that y[s) = h{z{s)) for all s, we arrive at the equality 

h{z{<d))= / e-^' G-{h{z{s)),z{s))ds, 

J —oo 

where z{s) = ips{z{0),h). Thus we conclude that if /i is a fixed point of the operator 
T-.X^JY, defined by 

{Th){z) = f e-'''G-{h{y,,{z,h)),ip,{z,h))ds, 

J — oo 

then /i is a center manifold of the equation. Note that there may be center manifolds that 
do not satisfy this equation, and thus we will not be proving uniqueness. 

Now we want to show that T is a contraction on X for an appropriate choice of e, 
K and p. Observe first that since all eigenvalues of B have a strictly negative real part. 
Lemma 2.2. 2| implies the existence of positive constants /? and K such that 

\\e-^'y\\ Ke^'\\y\\ VyGM"-,Vs^O. 

Since the eigenvalues of C have zero real parts, the same lemma implies that He*-"** z\\ is a 
polynomial in s. Hence, for every > 0, there exists a constant Q(j^) such that 

\\e^' z\\ ^ Q(i/) e'^l'lllzll G M"«, Vs G M . 

It is possible that Q{iy) — > oo as ^ 0. 

We first need to show that TX C X. Assume from now on that p ^ e, so that 
11/1(2;) II ^ £. The definition of G- implies that 

\\G.{h{z),z)\\^M'e^ 

for a constant M' > depending on M. Moreover, the derivatives of Go are of order e, so 
that there is a constant M" > depending on M with 

\\Go{h{zi),zi) - Go{h{z2),Z2)\\ ^ M"e[\\h{zi) - h{z2)\\ + \\zi - Z2II] 

^M"e{l + K)\\zi-Z2\\. 

A similar relation holds for G_. The bound on ||G_|| implies that 



\\Th{z)\\ ^ / Ke'^'M'e'^ds ^ 
J —00 



KM' 
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and hence ||T/i(2:)|| ^ p provided £ ^ {f3/ KM'){p/e). Next we want to estimate the 
Lipschitz constant of T. Let z\,Z2 G M"". By definition of the flow (^t(-, h), 

^(<y9t(zi,/i) - ipt{z2,h)) = C{ipt{zi,h) - ipt{z2,h)) 

+ Go{h{ipt{zi, h)), ipt{zi, h)) - Go{h{ipt{z2,h)),ipt{z2,h)). 

Taking into account the fact that ipo{z, h) = z, we get 
iptizi, h) - ipt{z2, h) = e^*[zi - Z2) 



+ I e^^^-'^\Go{h{ips{zi,h)),^s{zi,h)) - Go{h{ips{z2,h)),^s{z2,h)) 

Jo L 



ds. 



For t ^ 0, we obtain with the properties of Go 
\\^Pt{zi, h) - iptiz2, h)\\ ^ Qiv) e'^^Wzi - Z2\\ 

+ Q{u)e-''^'-'^ M"e{l + K)ys{zi,h) - <fsiz2,h)\\ds. 

We can now apply Gronwall's inequality to ^'(t) = e''''^\\ip-.t{zi, h) — ip-t{z2, h)\\, with the 
result 

\\ipt{zi,h) - ipt{z2,h)\\ ^ Q{i')e~''^\\zi - Z2\\, 

where j = v + Q{v)M"£{l + k). We can arrange that 7 < /3, taking for instance u = (3/2 
and £ small enough. We thus obtain 



\\Th{zi)-Th{z2)\\ ^ 



rO 

/ K e^' M"£ {l + K)ys{zi,h)-^s{z2,h)\\ds 
J —00 



^ KM"£{1 + k)Q{i^) ,, ,, 

/3-7 

For any given k and v, we can find e small enough that \\Th{zi) — Th{z2)\\ ^ k\\zi — Z2\\. 
This completes the proof that TX C X. 

Finally, we want to show that T is a contraction. For /ii, ^2 € X, using 

\\Go{hi{ipsiz, hi)), ips{z, hi)) - Go{h2{(Ps{z, /i2)), ^Psiz, /i2)) || 

^ M"£[{1 + K)\\ips{z, hi) - ifsiz, h2)\\ + \h2 -hi\], 

we obtain in a similar way by Gronwall's inequality that 

WMz, hi) - iftiz, h2)\\ ^ 2^£M"\h2 - hi\ 

(this is a rough estimate, where we have thrown away some t-dependent terms). This 
leads to the bound 



\Thi{z) - Th2{z)\\ ^ ^M"efl + 2M"e(l + k)^^""^ 



\ho- h^\. 



Again, taking £ small enough, wc can achieve that ||T/ii(z) — Th2{z)\\ ^ ^\h2 — hi\ for 
some A < 1 and for all z G M"". This shows that T is a contraction, and we have proved 
the existence of a Lipschitz continuous center manifold by Banach's fixed point theorem. 
One can proceed in a similar way to show that T is a contraction in a space of Lipschitz 
differentiable functions. □ 
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One can also prove that if / is of class C", r ^ 2, then h is also of class . If / is 
analytic or C°°, however, then h will be C^' for all r ^ 1, but in general it will not be 
analytic, and not even C°°. In fact, the size of the domain in which h is C may become 
smaller and smaller as r goes to infinity, see |Ca81 | for examples. 

As pointed out in the proof of the theorem, the center manifold is not necessarily 
unique. It is easy to give examples of systems admitting a continuous family of center 
manifolds. However, as we shall see, these manifolds have to approach each other extremely 
fast near the equilibrium point, and thus the dynamics will be qualitatively the same on 
all center manifolds. 



Example 3.1.4. The system 



y 

z 



-y 



(3.1.3) 



admits a two-parameter family of center manifolds 

y = h{z,ci,C2) 



^cie-V2-' 




C2 e 



-1/2^2 



for z > 
for z = 
for z < 0. 



(3.1.4) 



The operator T in the proof of Theorem 3.1.2 admits a unique fixed point h{z) = 0, but 
there exist other center manifolds which are not fixed points of T. Note, however, that all 
functions h{z, 01,02) have identically zero Taylor expansions at z = 0. 

3.1.2 Properties of Center Manifolds 



We assume in this section that x* is a non- hyperbolic equilibrium point of /, such that 
A = ^{x*) has no ^ 1 eigenvalues with zero real parts and n_ ^ 1 eigenvalues with 
negative real parts. In appropriate coordinates, we can write 



y 



By + g-{y,z) 
Cz + gQ{y,z), 



(3.1.5) 



where all eigenvalues of B have strictly negative real parts, all eigenvalues of C have zero 
real parts, and g-{y, z), go{y, z) are nonlinear terms. Theorem |3.1.2| shows the existence of 
a local center manifold with parametric equation y = h[z). The dynamics on this locally 
invariant manifold is governed by the equation 



ii = Cu + go{h{u),u). 



(3.1.6) 



Equation ( 3.1.6 ) has the advantage to be of lower dimension than ( 3.1.5 ), and thus easier 
to analyse. The following result shows that ( 3.1.6D is a good approximation of ( p. 1.5]) . 

Theorem 3.1.5. If the origin of (|3.1.6D is stable (asymptotically stable, unstable), then 
the origin of ( p. 1.5 ) is stable (asymptotically stable, unstable). 

Assume that the origin of ( |3.1.6| ) is stable. For any solution {y{t),z{t)) of ( p. 1.5 ) with 
(y(0),z(0)) sufficiently small, there exist a solution u{t) of ( |3.1.6| ) and a constant 7 > 
such that 

y{t) = h{u{t)) + 0{e-^') 
z{t) = u{t) + 0{e-^^) 



(3.1.7) 



as t 



00. 
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For a proof, see [Ca81|. The center manifold is said to be locally attractive. Note that 
if the center manifold is not unique, then ( p.1.7 ) holds for any center manifold. 



Let us now discuss how to compute center manifolds. In the proof of Theorem 3.1.2 



we used the fact that /i is a fixed point of a functional operator T. While being useful to 
prove existence of a center manifold, T is not very helpful for the computation of h, but 



there exists another operator for this purpose. Replacing y by h{z) in ( 3.1.5 ), we obtain 



dh 



— (z) [Cz + goih{z),z)] = Bh{z) + g-{h{z),z). 



(3.1. 



> no 



For functions q 
the origin, let us define 



which are continuously differentiable in a neighbourhood of 



{L^){z) = -£{z) [Cz + go{^{z),z)\ - B4>{z) - g-{4>{z), z). 



(3.1.9) 



Then (3.1.8) implies that {Lh){z) = for any center manifold of ( 3.1.5| ). This equation 
is impossible to solve in general. However, its solutions can be computed perturbatively, 
and the approximation procedure is justified by the following result, which is also proved 



in [CaSl]. 



Theorem 3.1.6. LetU he a neighbourhood of the origin in M""^ and let 4> S C^(Z//,M"'-) 
satisfy (t){<d) = and |^(0) = 0. // there is a q > 1 such that {L(j)){z) = 0{\\z\\i) as z ^ 0, 
then \\h{z) — (p{z)\\ = OdlzW^) as z ^ for any center manifold h. 

An important consequence of this result is that if hi and /i2 are two different center 
manifolds of x*, then one must have hi{z) — h2{z) = OdlzW'') for all q > I, i.e., all center 
manifolds have the same Taylor expansion at z = 0. 

Example 3.1.7. Consider the two-dimensional system 

2 



y 

z 



-y + cz 
yz - z^, 



(3.1.10) 



where c is a real parameter. We want to determine the stability of the origin. Naively, one 
might think that since the first equation suggests that y{t) converges to zero as t — > oo, 
the dynamics can be approximated by projecting on the line y = 0. This would lead to 
the conclusion that the origin is asymptotically stable, because z = —z^ when y = 0. We 
will now compute the center manifold in order to find the correct answer to the question 
of stability. The operator ( |3.1.9| ) has the form 



(L0)(z) = 0'(z) [z(l){z) - z^] + 0(z) - cz^. 



(3.1.11) 



Theorem 3.1.6 allows us to solve the equation {Lh){z) = perturbatively, by an Ansatz 
of the form 



h{z) = h2z'^ + hsZ^ + hiZ^ + 0{z^) 

The equation [Lh){z) = becomes 



(3.1.12) 



{Lh){z) = (/l2 - C)Z^ + h^iZ^ + [/l4 + 2/l2(/i2 - 1)] + 0{z^) = 0, (3.1.13) 
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which requires /i2 = c, /13 = and /14 = — 2c(c — 1). Hence the center manifold has a 
Taylor expansion of the form 

h{z) = cz^ - 2c{c - l)z^ + 0{z^), (3.1.14) 

and the motion on the center manifold is governed by the equation 

u = uh{u) -u^ = {c- l)v? - 2c(c - l)n^ + 0{u^). (3.1.15) 

It is easy to show (using, for instance, as a Liapunov function) that the equilibrium 
point u = is asymptotically stable if c < 1 and unstable if c > 1. By Theorem |3.1.5 



we conclude that the origin of the system (|3.1.1[l| ) is asymptotically stable if c < 1 and 
unstable if c > 1, which contradicts the naive approach when c > 1. 

The case c = 1 is special. In this case, the function h{z) = is an exact solution of 



the equation {Lh){z) = 0, and the curve y = z \s the unique center manifold of ( 3.1.10 ), 



which has the particularity to consist only of equilibrium points. The origin is thus stable. 



3.2 Bifurcations of Differential Equations 



We consider in this section parameter-dependent ordinary differential equations of the 
form 



where x G P C 



x = /(x,A), (3.2.1) 
""j A G A C MP and / is of class C for some r ^ 2. We assume that 



(a:;*,0) is a bifurcation point of (|3.2.1| ), which means that 

= 

-(x^o) = A 



/(x^o) 

dx 



(3.2.2) 



where the matrix A has tiq ^ 1 eigenvalues on the imaginary axis. When A = 0, the 
equilibrium point x* admits a center manifold. We would like, however, to examine the 
dynamics of ( |3.2.1 ) for all A in a neighbourhood of 0, where the center manifold theorem 
cannot be applied directly. There is, however, an elegant trick to solve this problem. In 
the enlarged phase space I? x A, consider the system 



X 

A 



fix A) 
0. 



(3.2.3) 



It admits (x*, 0) as a non-hyperbolic equilibrium point. The linearization of ( p. 2. 3 ) around 
this point is a matrix of the form 



'A i(x^o)^ 

,0 , 



(3.2.4) 



which has uq + p eigenvalues on the imaginary axis, including the (possibly multiple) 
eigenvalue zero. This matrix can be made block-diagonal by a linear change of variables. 
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where one of the blocks contains aU eigenvalues with zero real part. In these variables, 



the system ( 3.2.3 ) becomes 



y = By + g-{y,z,X) 

z = Cz + D\ + go{y,z,X) 

A = 0. 



(3.2.5) 



Here the (n — no) x (n — no) matrix B has only eigenvalues with nonzero real parts, the 
no X no matrix C has all eigenvalues on the imaginary axis, D is a matrix of size no x p, 
and 



\g^{y,z,X)\l \\goiy,z,X)\\ ^ M{\\yf + \\zf + \\Xf) 



(3.2.6) 



in a neighbourhood of the origin, for some positive constant M. We can thus apply 
Theorem |3.1.2 , which shows the existence of a local invariant center manifold of the form 
y = h{z, A). The dynamics on this manifold is governed by the no-dimensional equation 



Cu + DX + go{h{u, A), n. A). 



(3.2.7) 



If A has no eigenvalues with positive real part. Theorem p.l.5| shows that this equation 
gives a good approximation to the dynamics of ( 3.2.1| ) for small A and near x = x*. The 
big advantage is that generically, the number of eigenvalues on the imaginary axis at the 
bifurcation point is small, and thus the reduced equation ( 3.2.7| ) is of low dimension. 

With these preliminaries, it becomes possible to investigate bifurcations in a systematic 
way. Recall that A is a real matrix, and thus its eigenvalues are either real or appear in 
complex conjugate pairs. Thus the two simplest bifurcations, which we will consider below, 
involve either a single zero eigenvalue, or a pair of conjugate imaginary eigenvalues. More 
complicated bifurcations correspond to a double zero eigenvalue, a zero eigenvalue and 
two conjugate imaginary ones, and so on. These cases are, however, less "generic", and 
we will not discuss them here. 



Exercise 3.1. Show that the Lorenz equations ( |1.3.9 ) admit {X,Y,Z) = (0,0,0), r = 1 as 
a bifurcation point. Compute an approximation to second order of the center manifold in 
the extended phase space, and deduce the equation governing the dynamics on the center 
manifold. Hint: let B? = {a — 1)^ + Ara. To put the system into the form ( 3.2.5 ), use the 



transformation X = a{z — 1/2), Y = ^{1 — a){y2 — z) + \R{y2 + -z), Z = yi, and r = 1 + A. 



3.2.1 One-Dimensional Center Manifold 

We first discuss bifurcations involving a single eigenvalue equal to zero, i.e. no = 1 and 
C = 0. The dynamics on the one-dimensional center manifold is governed by an equation 
of the form 



u = F{u, A), 



u G 



We will also assume that A G M . The origin (0, 0) is a bifurcation point of ( ^.2.{ 

dF 

F(0,0)=0, _(0,0) = 0. 



(3.2.8) 

meaning 

(3.2.9) 
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(^2,92) 



Figure 3.1. (a) Definition of the Newton polygon. White circles correspond to points 
{p, q) such that Cpq ^ 0, black circles to points {p, q) such that p + q = r. The slopes of 
full lines correspond to possible exponents of equilibrium branches, (b) The setting of the 
proof of Proposition 3.2.2. 



In order to understand the dynamics for small u and A, we need in particular to determine 
the singular points of F, that is, we have to solve the equation F{u, A) = in a neigh- 
bourhood of the origin. Note that the second condition in ( |3.2.9| ) implies that we cannot 
apply the implicit function theorem. 

Let us start by expanding F in Taylor series, 



F(n, \)= Yl CP9^^^' + 



p+q^r p+q=r 



nPA«i?p,(n,A), 



(3.2.10) 



where the functions Rpg are continuous near the origin, Rpg{0, 0) = and 



1 dP+iF 



(0,0). 



(3.2.11) 



p\q\ duPdXi ' 

The bifurcation conditions ( |3.2.9 ) amount to cqo = cio = 0. An elegant way to describe 
the solutions of F{u, A) = is based on Newton's polygon. 



Definition 3.2.1. Consider the set 

A= {{p,q) p + q and Cpg ^ O} . 



(3.2.12) 



(In case F is analytic, we simply drop the condition p + q ^ r). For each {p,q) £ A, we 
construct the sector {(x, y) G : x ^ p and y ^ q}- The Newton polygon V of ( |3.2.10D 
is the broken line in M ^ defined by the convex envelope of the union of all these sectors, 



see Fig. 3.1a. 



Proposition 3.2.2. Assume for simpliciti]^ that Cpq 7^ whenever p -\- q = r. Assume 
further that the equation F{u,X) = admits a solution of the form u = C|A|'^(1 + p(A)) 
for small X, where C ^ and p{X) — > continuously as X ^ 0. Then Newton's polygon 
must have a segment of slope —fj,. 

Proof: It is sufficient to consider a function F of the form 

3 



F{u,X)=Y, 



aw 



1=1 



^This assumption allows to neglect all remainders Rpq{u,X), and to avoid pathological situations such 

as F{u, A) = fi^ - A^/^ 
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Indeed, if the expansion ( |3.2.10 ) contains only two terms, the result is immediate, and if 



it has more than three terms, one can proceed by induction. The hypothesis implies 

3 

5^ diCiCf^ I A^P^+^^l + p(A)r = 0, 

i=l 

where ai = ±1. Assume for definiteness that pifi + <?i ^ P2/^ + ^2 ^ Ps/^ + Q3- Consider 
first the case pifj, + qi < p2fJ. + q2- Then division be |A|^p^+''i gives 

3 
1=2 

The exponent of |A| is strictly positive. Thus taking the limit A — > 0, we obtain C^^ = 0, 
a contradiction. We conclude that we must have pifi + qi = P2P + q2- Graphically, the 
relation pip + qi = p2/i + Q2 ^ PsfJ- + ^3 means that p = is minus the slope of the 

segment from {pi,qi) to (^2,92), and that (^3,^3) lies above, see Fig. |3.1| b. □ 

This result does not prove the existence of equilibrium branches u = u*{X), but it tells 
us where to look. By drawing Newton's polygon, we obtain the possible values of p. By 
inserting the Ansatz u*{X) = C|A|'^(l + yo) into the equation F{u, X) = 0, we can determine 
whether of not such a branch exists. This is mainly a matter of signs of the coefficients 
Cpq. For instance, the equation + A^ = admits no solution other than (0, 0), while the 
equation — A^ = does admits solutions u = ±X. 

Saddle-Node Bifurcation 

We now illustrate the procedure of computing equilibrium branches in the generic case 
r = 2, C20 / 0, coi / 0. Then 

F(n,A) = coiA + C2o'u^ + ciiuA + co2A2+ ^ uPXmpg{u,X), (3.2.13) 

p+q=2 

and Newton's polygon has two vertices (0, 1) and (2, 0), connected by a segment with slope 
— 1/2. Proposition p.2.2| tells us that if there is an equilibrium branch, then it must be of 
the form u = C|A|^/^(1 + p{X)), where lim^^^o p('^) = 0. In fact, it turns out to be easier 
to express A function of u: 

Lemma 3.2.3. In a neighbourhood of the origin, there exists a continuous function p{u) 
with p(0) = such that F{u, X) = if and only if 

A = -^u2(l + p('u)). (3.2.14) 
coi 



Proof: Proposition p. 2. 2 indicates that any equilibrium branch must be of the form 
A = Cii^(l + p{u))). Define the function 



G{p,u) = \f{u,Cu'^{1 + p)). 



Using the expansion (3.2.13) of F, it is easy to see that 



lim G(0, u) = coiC + C20, 

u— >0 



50 



CHAPTER 3. LOCAL BIFURCATIONS 



a u ^ 


i b u ^ 
^ ~~ 

/ \ 






>- 

A J 

\ / 
X >^ 




A 



Figure 3.2. Saddle-node bifurcation, (a) in the case coi > 0, C20 < (direct bifurcation), 
and (b) in the case coi > 0, C20 > (indirect bifurcation). The other cases are similar, 
with stable and unstable branches interchanged. Full curves indicate stable equilibrium 
branches, while dashed curves indicate unstable equilibrium branches. 



and thus G(0, 0) = if and only if C = — C2o/coi- Moreover, using a Taylor expansion to 
first order of one obtains 

lim— (0,n) = coiC/0. 
M^O op 

Thus, by the implicit function theorem, there exists, for small u, a unique function p{u) 
such that p(0) = and G{p{u),u) =0. □ 

Expressing u as a function of A, we find the existence of two equilibrium branches 



u = ul{X) = ±J-^X\l + p{X)], (3.2.15) 

V C20 ' 

which exist only for sign A = — sign(coi/c2o)- Their stability can be determined by using 
the Taylor expansion 

— {u,X) = 2c2ou + cnX+ Yl u^^'^Rpqiu, X), (3.2.16) 

p+q=l 



where Rpq are some continuous functions vanishing at the origin. Inserting ( 3.2.15| ), we 

get 



dF 
du 



(ni(A), A) = ±2c2o./-— A + o{^\). (3.2.17) 
V C20 



We thus obtain the following cases, depending on the signs of the coefficients: 

1. If coi > and C20 < 0, the branches exist for A > 0, is stable and n* is unstable; 

2. if coi < and C20 > 0, the branches exist for A > 0, u!^ is unstable and u*_ is stable; 

3. if cqi < and C20 < 0, the branches exist for X <Q, u\. is stable and u*_ is unstable; 

4. if Cqi > and C20 > 0, the branches exist for A < 0, u* is unstable and li* is stable. 

These bifurcations are called saddle-node bifurcations, because when considering the full 
system instead of its restriction to the center manifold, they involve a saddle and a node. 
If the branches exist for A > 0, the bifurcation is called direct, and if they exist for A < 0, 



it is called indirect (Fig. 3.2). 
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Figure 3.3. Transcritical bifurcation, in the case of equation ( 3.2.21 ) with C2o < and 
cii > 0. 



It is important to observe that the quahtative behaviour depends only on those co- 
efficients in the Taylor series which correspond to vertices of Newton's polygon. Thus 
we could have thrown away all other terms, to consider only the truncated equation, or 
normal form, 



u = C2ou^ + coiX. (3.2.18) 



Transcritical Bifurcation 



Let us consider next the slightly less generic case where cqi = 0, but C20 7^ 0, cn / 0, 
C02 7^ 0. Then the Taylor expansion of F takes the form 

F{u,X) = C2ou^ + cuuX + co2X^ + uPXmpq{u,X), (3.2.19) 

p+q=2 

and Newton's polygon has three vertices (0,2), (1,1) and (2,0), connected by segments 



of slope —1. Proposition 3.2.2 tells us to look for equilibrium branches of the form u 



CA(1 + p{X)). Proceeding in a similar way as in Lemma |3.2.3| , we obtain the conditions 

c.oC^ + cnC + co2 = 
2c2oC2 + cnC / 

for the existence of a unique equilibrium branch of this form. We thus conclude that if 
— 4c2oco2 > 0, there are two intersecting equilibrium branches. It is easy to see that 

the linearization of / around such a branch is (2c2oC + cii)A + o{X), and thus one of the 

branches is stable, the other is unstable, and they exchange stability at the bifurcation 

point. This bifurcation is called transcritical. 

If Cii — 4c2oCo2 < 0, there are no equilibrium branches near the origin. Finally, if 

cf^ — 4c2oCo2 = there may be several branches with the same slope through the origin. 
Let us point out that the condition C02 7^ is not essential. In fact, one often carries out 

a change of variables taking one of the equilibrium branches to the A-axis. The resulting 

normal form is 

u = C2o'M^ + ciiuA. (3.2.21) 



One of the equilibrium branches is u = 0. The slope of the other branch and the stability 
depend on the signs of C20 and cn (Fig. 3.3). 
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Figure 3.4. Pitchfork bifurcation, (a) in the case cn > 0, C30 < (supercritical bifurca- 
tion), and (b) in the case cn > 0, C30 > (subcritical bifurcation). 



Pitchfork Bifurcation 

One can go on like that for ever, considering cases with more coefficients in the Taylor 
series equal to zero, which is not especially interesting unless one has to do with a concrete 
problem. However, sometimes symmetries of the differential equation may cause many 
terms in the Taylor expansion to vanish. Consider the case F S satisfying 

F(-?i,A) = -F(u,A) V(n,A). (3.2.22) 

Then Cpq = for even p. In fact, -F(n, A)/'u is near the origin and thus we can write 

F(ti,A) =u ciiA + C3on2 + ci2A2+ ^ uP X'iRpg{u, X) . (3.2.23) 

p+q=2 

The term in brackets is similar to the expansion for the saddle- node bifurcation, and thus 
we obtain similar equilibrium branches. In addition, there is the equilibrium branch n = 0. 
Depending on the signs of the coefficients, we have the following cases: 

1. If Cll > and C30 < 0, the branch u = is stable for A < and unstable for A > 0, 
and two additional stable branches exist for A > 0; 

2. if Cll < and C30 > 0, the branch n = is unstable for A < and stable for A > 0, 
and two additional unstable branches exist for A > 0; 

3. if Cll > and C30 > 0, the branch u = is stable for A < and unstable for A > 0, 
and two additional unstable branches exist for A < 0; 

4. if Cll < and C30 < 0, the branch n = is unstable for A < and stable for A > 0, 
and two additional stable branches exist for A < 0. 

This situation in called a pitchfork bifurcation, which is said to be supercritical if 
stable equilibrium branches are created, and subcritical is unstable equilibrium branches 



are destroyed (Fig. |3.4| ) . The normal form of the pitchfork bifurcation is 

u = ciiXu + czqu-^ . (3.2.24) 
In Physics, this equation is often written in the form 

u = -^{u, A), V{u, A) = -^Au2 - (3.2.25) 

If C30 < 0, the function V{u, A) has one or two minima, and in the latter case it is called 
a double-well potential. 

Exercise 3.2. Consider the case F G with C20 = cn = and C30, cn, C02 7^ 0, without the 
symmetry assumption ( 3.2.221) and discuss the shape and stability of equilibrium branches. 
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3.2.2 Two-Dimensional Center Manifold: Hopf Bifurcation 

We consider now the case uq = 2, with C having eigenvalues iiwo, where luq ^ 0. The 
dynamics on the center manifold is governed by a two-dimensional system of the form 



F(n,A), 



(3.2.26) 



where we shall assume that A G M and F G 



Since 11(0,0) 



C is invertible, the 

implicit function theorem (Theorem 3.0.1) shows the existence, near A = 0, of a unique 
equilibrium branch u*(A), with n(0) = and F{u*{X),X) = 0. By continuity of the 
eigenvalues of a matrix-valued function, the linearization of F around this branch has 
eigenvalues a(A) it iuj{X), where u;(0) = ujq and a(0) = 0. A translation of — u*(A), 
followed by a linear change of variables, puts the system (|3.2.26 ) into the form 



a(A) 
^(A) 



-u;(A) 
a(A) 



+ 



5^1(1*1,-^2, A) 

52(^1, M2, A) 



(3.2.27) 



where the gi are nonlinear terms satisfying \\gi{ui,U2, A)|| ^ M(n^ + U2) for small ui and 
U2 and some constant M > 0. 

Our strategy is now going to be to simplify the nonlinear terms as much as possible, 
following the theory of normal forms developed in Subsection 2.2.4. It turns out to be 
useful to introduce the complex variable z = ui + iu2 (an idea going back to Poincare), 
which satisfies an equation of the form 



i= [a{X) +iuj{X)]z + g{z,z,X), 



(3.2.28) 



where z is the complex conjugate of z. This should actually be considered as a two- 
dimensional system for the independent variables z and z: 



z= [a{X) + iu!{X)]z + g{z,z,X), 
z= [a{X) — iu!{X)\z + g{z,z, X). 



(3.2.29) 



Lemma |2.2.20| shows that monomials of the form CpZ^'^'z^^ in the nonlinear term g can 
be eliminated by a nonlinear change of variables, provided the non-resonance condition 
( 2.2.50 ) is satisfied. In the present case, this condition has the form 

{pi +P2- l)a(A) + {pi - P2 T 1) i^(A) / 0, (3.2.30) 

where the signs =F refer, respectively, to the first and second equation in ( |3.2.2S| ). This 
condition can also be checked directly by carrying out the transformation z = C + ^pC^^C^^ 
in ( 3.2.29 ). Condition ( 3.2.30 ) is hardest to satisfy for A = 0, where it becomes 

(pi-p2Tl)ic^o/0. (3.2.31) 

Since / by assumption, this relation always holds for pi + P2 = 2, so quadratic 
terms can always be eliminated. The only resonant term of order 3 in 51 is z'^z = \z\'^z, 
corresponding to (^1,^2) = (2,1). (Likewise, the term zz'^ = \z\'^z is resonant in g.) 
We conclude from Proposition |2.2.19| that there exists a polynomial change of variables 
z = C + h{(, C), transforming ( p.2.28| ) into 



C = [a(A) + -MX)] C + c{X)\C\\ + R{C, C, A), 



(3.2.32) 
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Figure 3.5. Supercritical Hopf bifurcation. The stationary solution (mi,M2) = (0,0) is 
stable for A < and unstable for A > 0. For positive A, a stable periodic orbit close to a 
circle of radius a/A appears. 



where c(A) G C and i?(C,C,A) = odCP) (meaning that lim^^olCr^-R(C, C, A) = 0). Equa- 
tion ( p.2.32| ) is the normal form of our bifurcation. To analyse it further, we introduce 
polar coordinates = re"'', in which the system becomes 



r = a(A)r + Re c( A)r^ + Ri (r, ip, A) 
(p = uj{X) + Im c(A)r^ + R2{r, (p, A), 



2 , „ , (3.2.33) 



where Ri = o(r^) and R2 = ©(r^). We henceforth assume that a'(0) 7^ 0, and changing A 
into —A if necessary, we may assume that a'(0) > 0. If we discard the remainder Ri, the 
first equation in ( |3.2.33 ) describes a pitchfork bifurcation for r, which is supercritical if 



Rec(O) < 0, and subcritical if Rec(O) > 0. The first case corresponds to the appearance 
of a stable periodic orbit, of amplitude y^— a(A)/Rec(A) (Fig. 3^), the second to the 



destruction of an unstable periodic orbit. The rotation frequency on this orbit is u>q+0{X). 

It remains to show that this picture is not destroyed by the remainders i?i and i?2- 
Note that in the present case we cannot apply the Poincare-Sternberg-Chen theorem (The- 



orem 2.2.21) because the linear part is not hyperbolic. 



Theorem 3.2.4 (Andronov-Hopf). Assume that the system x = f{x,X) admits an 
equilibrium branch x*{X) such that the linearization of f at x*(A) has two eigenvalues 
a(A) lb ia;(A), with a(0) = 0, a'(0) > and uj{0) ^ 0, and all other eigenvalues have 
strictly negative real parts. If the coefficient c(A) in the normal form ( 3.2.32]) satisfies 
Re c(0) 7^ 0, then 

• if Re c(0) < 0, the system admits a stable isolated periodic orbit for small positive X, 
close to a circle with radius proportional to \/A (supercritical case); 

• if Re c(0) > 0, the system admits an unstable isolated periodic orbit for small negative 
X, close to a circle with radius proportional to \/—X (subcritical case). 



Proof: There exist various proofs of this result. One of them is based on the method of 
averaging, another one on the Poincare-Bendixson theorem. Since we did not introduce 
these methods, we will give a straightforward geometrical proof. The main idea is to 
consider the set {(r, (^) : = 0, r > 0} as a Poincare section, and to examine the associated 
Poincare map. Consider the case Rec(O) < 0. If we assume that < A ^ 1, set r = \/A/0 
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in ( 3.2.33 ), and expand the A-dependent terms, we arrive at the equivalent system 



p = p [a'(0) A + Re c(0) A/)^ + o{X)] 
ip = uJo + X[lmc{0)p^ +uj'{0)] +o(A). 



Let po = 1^— a'(0)/Rec(0). We shah consider this system in the disc p ^ 2po- The second 
equation tehs us that 9? 7^ (say, 99 > 0) for A smah enough. Under this condition, we can 
use if instead of t as new time variable, and write the system in the form 

«'(0)J. P' 



p= p 



A - ^A + o(A) 
Po 



We define a Poincare map P by the fact that the solution starting at (p, 0) passes, after one 
revolution, through the point {P{p),2tt). P{p) is monotonous by uniqueness of solutions. 
Fix a constant 5 £ (0, 1). The term o{X) may depend on ip, but by taking A small enough, 
it can be made smaller in absolute value than (5/2) A (uniformly in p for p ^ 2pq). It 
follows that 



iorO<p'^{l-6)pl: p^^pa(i-(1-<5)-^) 



> 

for (1 + 6)pI ^p'^: (2po)': P < ^pX(l - (1 + 5) + ^) < 0. 

This means that p{t) is monotonous outside the annulus {1 — 6)pq ^ p^ ^ {1+5)pq, and thus 
P cannot have fixed points outside the interval I = — 5 po, ^/l + 6 po]. Furthermore, 
since the vector field enters the annulus, P maps the interval / into itself, and must admit a 
fixed point p*. Returning to the original variables, we see that this fixed point corresponds 
to the desired periodic orbit. 

Finally, it is also possible to show that p* is the only fixed point of P in (0, 2pq). We 
know that there can be no fixed points outside / (except 0). By examining the error term 
o{X) a bit more carefully, one finds that p is a decreasing function of p near p = pQ. Thus, 
if pi < p2 belong to /, with 6 small enough, the orbits starting in pi and p2 must approach 
each other as time increases. This means that P is contracting in /, and thus its fixed 
point is unique. □ 

This bifurcation is called Poincare- Andronov-Hopf bifurcation. One should note that 
it is the first time we prove the existence of periodic orbits in any generality. Bifurca- 
tions with eigenvalues crossing the imaginary axis are common in parameter-dependent 
differential equations, and thus periodic orbits are frequent in these systems. 

The nature of the bifurcation depends crucially on the sign of Rec(O). This quantity 
can be determined by a straightforward, though rather tedious computation, and is given. 



for instance, in |GH83, p. 152]. 



Exercise 3.3. Show that the van der Pol oscillator 



1 3 

Xl = X2 + XXl Xi 

3 ^ (3.2.34) 

±2 = -Xl 



displays a Hopf bifurcation at the origin, and determine whether it is subcritical or super- 
critical. 
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3.3 Bifurcations of Maps 

We turn now to parameter-dependent iterated maps of the form 

Xk+i = F{xk,X), (3.3.1) 

with xGPcM", AgAcRP and F e for some r ^ 2. We assume again that {x*, 0) 
is a bifurcation point of ( p. 3.1 ), which means that 

F{x*,0) =x* 

dF, , , . (3.3.2) 

^i^\0)=A, 

where A has no ^ eigenvalues of module 1. For simplicity, we assume that all other 
eigenvalues of A have a module strictly smaller than 1. In appropriate coordinates, we 
can thus write this system as 

Vk+i = Byk + g-ivk, Zk, Xk) 

Zk+i = Czk + DXk + goivk, zk, Xk) (3.3.3) 
-^fc+i = Xk, 

where all eigenvalues of B are inside the unit circle, all eigenvalues of C are on the unit 
circle, and and go are nonlinear terms. One can prove, in much the same way we used 
for differential equations, the existence of a local invariant center manifold y = h{z,X). 
This manifold has similar properties as in the ODE case: it is locally attractive, and can 
be computed by solving approximately the equation 

h{Cz + DX + goiKz, A), z, A)) = Bh{z, X) + g^ih{z, A), z, A). (3.3.4) 

The dynamics on this manifold is governed by the no-dimensional map 

lifc+i = Cuk + DX + go{h{uk, A), Uk, A). (3.3.5) 

Since C is a real matrix with all eigenvalues on the unit circle, the most generic cases are 
the following: 

1. one eigenvalue equal to 1: no = 1 and C = 1; 

2. one eigenvalue equal to —1: no = 1 and C = — 1; 

3. two complex conjugate eigenvalues of module 1: no = 2 and C having eigenvalues 
g±27rieo with 26*0 

The first case is easily dealt with, because extremely similar to the case of differential 
equations. Indeed, the dynamics on the one-dimensional center manifold is governed by 
the equation 

dG 

Uk+i = Uk + G{uk,X), G(0,0)=0, — (0,0)=0. (3.3.6) 

The fixed points are obtained by solving the equation G{u, A) = 0, which behaves exactly 
as the equation F{u, A) = in Subsection 3.2.1. Let us simply indicate the normal forms 
of the most common bifurcations. For the saddle-node bifurcation, we have 

Uk+i = Uk + coiX + C2oul; (3.3.7) 
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for the transcritical bifurcation, one can reduce the equation to 

Uk+i = Uk + cuXuk + C2oul; (3.3.8) 
and for the pitchfork bifurcation, the normal form is given by 

Uk+i = Uk + ciiXuk + csoul. (3.3.9) 

Exercise 3.4-. Find the fixed points of the above three maps and determine their stabihty. 
Show that higher order terms do not affect the behaviour near the origin. If the map is a 
Poincare map associated with a periodic orbit T, what is the meaning of these bifurcations 
for the flow? 

3.3.1 Period-Doubling Bifurcation 

We turn now to the case no = 1, C = — 1, and assume that the map is of class C^. The 
map restricted to the center manifold has the form 

u,,, = -u, + G{u,Xl ^^^^^^ 
G(n, A) = coiA + C02A -\- ciiuX + C2QU + csqu H 

We first note that the implicit function theorem can be applied to the equation Uk+i = Uk, 
and yields the existence of a unique equilibrium branch through the origin. It has the form 

u = u*{X) = ^X + o{X) (3.3.11) 

and changes stability as A passes through if cn + C20C01 7^ 0. Thus something must 
happen to nearby orbits. To understand what is going on, it is useful to determine the 
second iterates. A straightforward computation gives 

Uk+2 = -Uk+1 + G{uk+i, A) 

= Uk- G{uk, A) + G{-Uk + G{uk, A), A) 

= Uk + coi(cii + coiC2o)A^ - 2(cii + colC2o)^ifcA - 2(c3o + cIq)uI H (3.3.12) 

Now let us consider the equation Uk+2 = u^, the solutions of which yield orbits of period 2. 
Using the method of Newton's polygon, we find that in addition to the solution u = u*(A), 
there exist solutions of the form 

2 CII+C2OCOI. , ^^/>X /QQ1Q\ 

u = 5 — A + O^A), (3.3.13) 

C30 + c^o 

provided C30 + c|q 7^ and cn + C20C01 / 0. In other words, the map Uk ^ Uk+2 undergoes 



a pitchfork bifurcation. The equilibrium branch (3.3.13) does not correspond to fixed 
points of ( p.3.10| ), but to an orbit of least period 2. We have thus obtained the following 
result: 

Theorem 3.3.1. Let F{-,X) : M — > R be a one-parameter family of maps of the form 



( 3.3.10 ), i.e., such that F{-,0) admits as a fixed point with linearization —1. Assume 

'^^^^'^^J^' (3.3.14) 
C30 + C20 / 0. 
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Figure 3.6. The supercritical flip bifurcation of a Poincare map, associated with a peri- 
odic r, corresponds to the appearance of a new periodic orbit with twice the period. 



Then there exists a curve of fixed points u = u*{\) passing through the origin, which 
changes stability at X = In addition, there is a curve of the form ( |3.3.13| ), tangent to 
the u-axis, consisting of points of period 2. The orbit of period 2 is stable if c^q + c|q > 
and unstable if C30 + < 0. 

This bifurcation is called a period doubling, flip or subharmonic bifurcation. It is called 
supercritical if a stable cycle of period 2 is created, and subcritical if an unstable orbit of 
period 2 is destroyed. 

Remark 3.3.2. If / is a function of class C^, its Schwartzian derivative is defined as 

The bifurcation is supercritical if the Schwartzian derivative of the map at (0, 0) with 
respect to u is negative, and subcritical if this derivative is positive. 

The period doubling bifurcation has an interesting consequence if F is the Poincare 
map associated with a periodic orbit T. Consider for instance the supercritical case. For 
A < 0, the Poincare map has a stable fixed point, which means that the periodic orbit F 
is stable. For A > 0, the fixed point is unstable and there exists a stable orbit of period 
two. In phase space, this means that the periodic orbit F has become unstable, but a new 
stable periodic orbit has appeared (Fig. |3.6| ). If F has period T for A = 0, the new orbit 
has a period close to 2T, or half the frequency (which accounts for the name subharmonic 
given to the bifurcation) . Note that this bifurcation requires a phase space with dimension 
at least 3. 



3.3.2 Hopf Bifurcation and Invariant Tori 

We finally consider what happens when two eigenvalues cross the unit circle in complex 
plane. Then we have to study the map 

Uk+i = Cuk + G{uk,X), (3.3.16) 

where n G M ^ , and C has eigenvalues e^^'^ ^ ^° with 26q Z . We shall assume that A G M 
and G £ C^. As in the case of differential equations, the implicit function theorem shows 
the existence of an equilibrium branch u*(A) through the origin. The linearization around 
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this branch has eigenvalues fx{X) = p{X) e^'^^^^^^ and /i(A), with p(0) = 1 and ^(0) = 6q. 
An appropriate Unear change of variables casts the system (3.3.16) into the form 

Zk+i = fJ.iX)zk + g{zk,Zk,X), (3.3.17) 

where 5 is a nonlinear term, which we will try to simplify by normal form theory. We can 
assume that 

g{z,z, X) = g2(z,z, A) + g3{z,z, X) + o{\zf), (3.3.18) 

where 32 is a homogeneous polynomial of degree 2 in z, z, and g^ is of degree 3. Normal 
form theory for maps is very similar to normal form theory for differential equations. In 
fact, if h2{z,z,X) satisfies the homological equation 

h2{fJ.{X)z,J[{X)z, A) - n{X)h2{z,z, A) = g2{z,z, A), (3.3.19) 

then it is easy to see that the transformation z = C + /i2(C, Ci '^) eliminates terms of order 
2 from ( p.3.17| ) . A similar transformation can be used to eliminate terms of order 3. Let 
us now try to solve the homological equation, assuming 

h2iz,z,X)= KiW^"^^ 92iz,z,X)= Cpg(A)zfz''. (3.3.20) 

p+q=2 p+q=2 

Substitution into (|3.3.19 ) shows that 



In particular, for A = 0, we obtain 



- g27rieo ^Q2Jill{p-q-i) _ij " (3.3.22) 

This equation can only be solved under the non-resonance condition 

^2nieo{p-q-l) ^ ^ (3.3.23) 

Since 26q Z , this condition is always satisfied for (p, q) = (2, 0) and (1, 1). Thus terms of 
the form and zz can always be eliminated. Terms of the form z^, however, can only be 
eliminated if 3^o is not an integer. Similarly, third order terms of the form z^ and zz'^ can 
always be eliminated, terms of the form can only be eliminated if AOq is not an integer, 
while the term z'^z can never be removed. We conclude that if 6^^^^^° is neither a cubic nor 
a quartic root of unity, there exists a polynomial change of variables transforming (3.3.17) 
into its normal form 

Ck+i = M(A)a + c(A)|Cfc|'a + o{\Ckf). (3.3.24) 

Using polar coordinates Cfc = fk e' , one obtains a map of the form 

n+i = p{X)rk + a{X)rl + o{rl) ro o 

r, o (3.3.25) 
ipk+i = ipk + 27:e{X)+(3(X)rl + o{rl). 

An explicit calculation shows that if c(A) = |c(A)| q'^'^^'^W ^ then the coefficients a and /3 
are given by 

a(A) = |c(A)|cos27r(V'(A) -^(A)), /3(A) = sin 27r(V'(A) - 0(A)). (3.3.26) 

P[X) 
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Figure 3.7. If the Poincare map of a periodic orbit F undergoes supercritical Hopf bifur- 
cation, an attracting invariant torus is created. 



If we neglect the remainders, the map ( 3. 3. 251) describes a pitchfork bifurcation for the 



radial variable r. Depending on the signs of p'{0) and a(0), there will be creation or 
destruction of an invariant circle. This can be proved to remain true when the o{-) terms 
are present, but the proof is more difficult than in the case of differential equations. 

Theorem 3.3.3 (Ruelle). Let F{-, X) : ^ be a one-parameter family of maps, 
admitting a smooth curve of fixed points u*{X). Assume the linearization around the fixed 
points has complex conjugate eigenvalues /i(A) and 7i(A) such that 

|/x(0)| = l but fiioy ^1 for j = 1,2,3,4, (3.3.27) 
d 



dA' 



|MA)| _/0. (3.3.28) 



A=0 



Then there is a smooth change of coordinates transforming the map F into ( 3.3.251 ) . // 
a(0) 7^ 0, then the map admits, either for small positive A or for small negative X, an 
invariant curve close to a circle of radius \/\X\. 

In the strongly resonant cases /u(O)-' = 1 for j = 1,2,3 or 4, the situation is more 
complicated, and there is no invariant curve in general. If such an invariant curve exists, 
the dynamics on this curve is described by a circle map. The theory of circle maps is a 
huge subject in itself. Roughly speaking, they can be characterized by a rotation number, 
measuring the average angle of rotation per iteration. Two cases can occur: 

• if the rotation number is rational, there exists a periodic orbit, which usually attracts 
most orbits; 

• if the rotation number is irrational, all orbits are dense, and under suitable smoothness 
assumptions, the map is conjugate to a rotation. 

If the bifurcating map is the Poincare map of a periodic orbit F, the invariant circle will be 
the intersection of an invariant torus with the Poincare section S (Fig. |3.7| ). If the rotation 
number is irrational, orbits fill this torus in a dense way. They are called quasiperiodic 
(with two frequencies), which means that any solution x{t) on the invariant torus can be 
written as 

x{t) = H{ujt,uj't), H{u + l,v) = H{u,v + 1) = H{u,v), (3.3.29) 

where uj/oj' is equal to the irrational rotation number. Besides invariant points, curves, 
and manifolds, we have thus found a new kind of invariant set appearing quite commonly 
in dynamical systems. 



Chapter 4 

Introduction to Chaotic Dynamics 



The characterization of chaotic dynamics is a large subject, with many recent develop- 
ments, and ramifications in several domains of Mathematics. We will discuss here only a 
few selected topics, the major objective being to provide an idea of what we call chaotic 
motion. 

The definition of chaos may vary from system to system, but usually at least one of 
the following elements is present: 

• The time dependence of solutions is more complicated than stationary, periodic or 
quasiper iodic. 

• The motion is very sensitive to variations in the initial conditions: nearby solutions 
diverge exponentially fast. 

• The asymptotic motion takes place on a geometrically complicated object (often a 
fractal), called a strange attractor. 

• Chaotic orbits coexist with a (countable) infinity of unstable periodic orbits; the num- 
ber of orbits of period less or equal T grows exponentially fast with T. 

• As time goes by, the images under the flow of any two subsets of phase space get 
entangled in a complicated way. 

These properties do not necessarily all occur at once: for instance, strange attractors 
cannot occur in conservative systems, but are quite typical in chaotic dissipative systems. 
Often, there are subtle relations between the above properties, many of which can be 
characterized quantitatively (by Liapunov exponents, topological entropy, ... ). 

Our approach in this introduction to chaotic dynamics will be to start with some very 
simple examples, where many of these chaotic properties can be proven to hold. Then we 
will show how similar properties can be proven to exist for more realistic systems. 

4.1 Symbolic Dynamics 

Symbolic dynamics is a very useful technique for characterizing dynamical systems. It 
consists in associating with every orbit a sequence of symbols, related to a partition of 
phase space, and describing in which order the orbit of x visits the elements of the partition. 
In this way, one can sometimes reduce the problem to a combinatorial one, by transposing 
the dynamics to the space of allowed symbolic sequences. 

We will start by illustrating the method on a very simple one-dimensional map called 
the tent map, and later discuss a less trivial two-dimensional map which is already useful 
in proving existence of chaotic orbits for a more general class of systems. 
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4.1.1 The Tent Map 



^6i2-\ 6, G{0,1}, X = bo.bib2b3 . . . (4.1.3) 



In Section 1.4, we claimed that the logistic map 

hiy) = Xy{l - y) (4.1.1) 

is as random as coin tossing when A = 4. Let us now explain what we meant. It is easy 
to check that the transformation y = h{x) = ^(1 — costtx) transforms the logistic map /4 
into the map 

/ X , 1 . w X f2x for ^ a; ^ i 

I 2 — 2x for ^ ^ X ^ 1. 

This map is called the tent map because of its triangular shape (one can define more 
general with slope ^ 7^ 2). In the transformation, we have lost differentiability at 
X = ^, but the piecewise linearity will be useful to classify the orbits. 

First of all, we note that the map ( [4.1.2| ) has two unstable fixed points, at and 2/3. 
We also observe that 1 is mapped to and 1/2 is mapped to 1, so there exist "transient" 
orbits, ending at after finitely many iterations. 

In order to understand the other orbits, it turns out to be a good idea to write x in 
binary expansion. We will write 
00 

X 

i=0 

This decomposition is not unique. Indeed, 

^2-^ = 1 0.1°° = 1.0°°, (4.1.4) 

i=l 

where the superscript °° means that the symbol is repeated indefinitely. This, however, is 
the only kind of degeneracy. For our purposes, the following convention will be useful. We 
denote by B the set of symbolic sequences b = O.6162 • • • which are not terminated by 0°°, 
except that we include the sequence 0.0°°. Then ( [4.1.3| ) defines a bijection b : [0, 1] — > B. 
In fact, ;S is a metric space with the distance 

d(^,&') = E(i- v,)2"^ (4-1-5) 
1=1 

where 5ab = 1 if a = 6 and otherwise, and b is continuous in the resulting topology. 

How does the tent map act on binary expansions? We first observe that x ^ 1/2 if 
and only if 61 = 0. In this case, 

00 00 

<72(0.06263 . . . ) = 2 bi2-' = J2 ^i+i^"' = 0-^263 • • • (4.1.6) 

i=2 i=l 

Otherwise, we have x > 1/2, 61 = 1 and 



32(0.16263 • • • ) = 2 - 2 [- + bi2-'] = 1 - 



i=2 i=l 



- bi+i)2-' = 0.(1 - 62)(1 - 63) . . • (4.1.7) 



i=l 



Hence 32 induces a map r from B to itself, defined by the following rules: 
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• shift all digits of b one unit to the left, discarding 60; 

• if the first digit is 1, reverse all digits; 

• replace the sequence 10°°, if present, by 01°°. 

We can now analyse the dynamics in B instead of [0, 1], which is easier due to the relatively 
simple form of r. In fact, (72 has an even simpler representation. With every b £ B, we 
associate a sequence e = (ei, £2, . . . ) defined by 

£^ = (-1)^^-1+^^ J = 1,2,... (4.1.8) 

The elements of e are —1 if adjacent digits of b are different, and +1 if they are equal. The 
set S of sequences e constructed in this way consists of {—1, +1}^ , from which we exclude 
sequences ending with (+1)°° and containing an even number of —1. The correspondence 



( 4.1.8 ) admits an inverse defined by 

j 



0, (-1)^^ = Eji-lp-' = J]e„ bj G {0, 1}, j ^ 1. (4.1.9) 



S can be endowed with a similar distance as (4.1.5), and then (4.1.8) defines a homeo- 



morphism between B and S, and, by composition with 6, a homeomorphism between [0, 1] 
and E. 

Treating separately the cases 61 = and 61 = 1, it is easy to see that the tent map 
induces a dynamics in S given by 

o : (ei, £2, £3, . . . ) ^ (£2, £3, • • • ) (4.1.10) 

which is called the shilt map. The sequence e has a very simple interpretation. Indeed, 

xG[0, i] ^ 61=0 ^ £i = +l, (4.1.11) 

so that 

ej = +l ^ a^{£)^ = +l ^ ^i(2;) g [0,1]. (4.1.12) 

We have thus shown that the sequence of ej indicates whether the j^^ iterate of x is to the 
left or to the right of 1/2, and that this information is encoded in the binary expansion of 
j2.{x). The sequence e associated with x is called its itinerary. 
Let us now examine the different possible orbits. 

1. Periodic orbits: The itinerary of a periodic orbit must be periodic. Conversely, if 
an itinerary e is periodic with period p ^ 1, then cr^(£) = £, and by bijectivity the 
corresponding x is a fixed point of c^. Thus x is a point of period p if and only if 
its itinerary is of the form £ = A°°, with A a finite sequence of length p. There are 
exactly 2^ such sequences, and thus 2P/p orbits of period p (the number of orbits of 
least period p can be a bit smaller). For instance, we obtain again the fixed points of 

92- 

-,00 



e = (+l)°° ^ 6 = 0.0°° ^ x = 

1 

2 ' 8 ' 32 ' 3' 



e = (-l)°° ^ 6 = 0.(10)°° ^ a; = l + l + J^ + --- = |. (4.1.13) 



2. Transient orbits: Itineraries of the form e = BA°° with B a finite sequence of length 
q correspond to orbits that reach a periodic orbit after a finite number of steps. 
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Exercise 4-1- Find all periodic orbits of periods up to 3 of the tent map. 

Let us call eventually periodic orbits which are either periodic, or reach a periodic orbit 
after a finite number of iterations. Their itineraries are of the form e = A°^ or e = BA°°. 
It is easy to see that the orbit of x G [0, 1] is eventually periodic if and only if x is rational]^ 
Q being dense in M , the union of all eventually periodic orbits is dense in [0, 1]. However, 
this set is countable and has zero Lebesgue measure. 

3. Chaotic orbits: All irrational initial conditions, by contrast, admit itineraries which 
are not periodic. The corresponding orbits will typically look quite random. 

The following properties are direct consequences of the symbolic representation: 

• For every sequence e E S, there exists an x G [0, 1] with itinerary e. We may thus 
choose the initial condition in such a way that the orbit passes left and right of 1 /2 in 
any prescribed order. 

• The dynamics is sensitive to initial conditions. If we only know x with finite precision 
6, we are incapable of making any prediction on its orbit after n iterations, whenever 
2" ^ 1/6. 

• However, simply by looking whether successive iterates of x lie to the left or right 
of 1/2, we are able to determine the binary expansion of x (even though §2 is not 
injective). 

• There exists a dense orbit. Indeed, choose x in such a way that its itinerary 

e = ( +1,^-1 ,+1^+1, +1^-1, -1^+1, -1^-1, +1,+1,+1 , ...,...) (4.1.14) 

period 1 period 2 period 3 

contains all possible finite sequences, ordered by increasing length. Given any 6 > 
and y G [0,1], one can find n G N such that \g2ix) — y\ < S. It suffices to take n 
in such a way that the shifted sequence a'^e and the itinerary of y agree for the first 
[|log(5|/log2] bits. 

Remark 4.1.1. The tent map g2 has other interesting properties, from the point of view 
of measure theory. The main property is that its unique invariant measure which is 
absolutely continuous with respect to the Lebesgue measure is the uniform measure. This 
measure is ergodic, meaning that 

lim - V(/^(<?^(x)) = / v'(x)dx (4.1.15) 

for every continuous test function ip, and for Lebesgue-almost all x G [0, 1]. Thus from a 
probabilistic perspective, almost all orbits will be uniformly distributed over the interval. 

Itineraries can be defined for more general maps, just by choosing some partition of 
phase space. In general, however, there will be no simple relation between a point and 
its itinerary, and the correspondence need not be one-to-one. Some symbolic sequences 



^If X has an eventually periodic orbit, its itinerary, and hence its binary expansion become eventually 
periodic, which implies that 2''^''x — G Z for some p,q ^ 1, and thus x £ Q. Conversely, let 
X = n/m £ Q . The map x ^ {2x}, where {•} denotes the fractional part, shifts the bits of b(x) one unit 
to the left. It also maps the set {0, 1/m, 2/m, . . . , (m — l)/m} into itself. Thus the orbit of x under this 
map is eventually periodic, and so are its binary expansion and its itinerary. 
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Figure 4.1. The first steps of tfie construction of tire Cantor set A. 



may never occur, and several initial conditions may have the same itinerary, for instance 
if they are in the basin of attraction of a stable equilibrium. 
Let us now consider the following variant of the tent map: 

^ ^ ( 3x for X ^ ^ ^ 
1 3 — 3x for rc ^ i . 

Since the interval [0, 1] is not invariant, we define on all of M . We first observe that 

• if xq < 0, the orbit of xq converges to — oo; 

• if xo > 1, then xi = g^ixo) < 0; 

• if xo G (1/3, 2/3), then xi = 53 (xq) > 1 and thus X2 < 0. 

Hence all orbits which leave the interval [0, 1] eventually converge to —00. One could 
suspect that all orbits leave the interval after a certain number of iterations. This is not 
the case since, for instance, orbits starting in multiples of 3~"' reach the fixed point after 
finitely many iterations. But there exists a more subtle nontrivial invariant set. In order 
to describe it, we use a ternary (base 3) representation of x G [0, 1]: 

00 

x = Y,ba~\ 6iG {0,1,2}, x = bo.bib2b3... (4.1.17) 

Again, this representation is not unique. We can make it unique by replacing 10°° with 
02~ and 12°° with 20°° if applicable. Now we observe that 

53(0.06263- ••) = 0.6263.-- 

53(0.26263 ■ • • ) = 0.(2 - 62)(2 - 63) . . . (4.1.18) 

Points of the form O.I6263 • • • belong to (1/3, 2/3), and we already know that these leave 
the interval [0, 1]. It is thus immediate that the orbit of x never leaves the interval [0, 1] if 
and only if its ternary expansion 6(x) does not contain the symbol 1. The largest invariant 
subset of [0, 1] is thus 

A = {x G [0, 1] : 6i(x) / 1 Vi ^ 1}. (4.1.19) 

A is obtained by removing from [0, 1] the open intervals (1/3,2/3), (1/9,2/9), (7/9,8/9), 
(1/27,2/27) and so on (Fig. |4.l| ). The resulting set is called a Cantor set: 

Definition 4.1.2. A set A is called a Cantor set if it is closed, its interior is empty, and 
all its points are accumulation points. 



66 



CHAPTER 4. INTRODUCTION TO CHAOTIC DYNAMICS 



Exercise 4.2. Prove that A defined in ( [4.1. 1S| ) is a Cantor set. 
The Cantor set A is an example of fractal. 

Definition 4.1.3. Let M be a subset of M"'. Assume that for any e > 0, A4 can be 

covered by a finite number of hypercubes of side length e. Let N(£) be the smallest possible 
number of such cubes. Then the box-counting dimension of Ai is defined by 

One easily shows that for "usual" sets M CM.'^, such as a d-dimensional hypercube, 
Do = d. For the Cantor set (|Tl|), however, we find that N{e) = 2" if 3"" ^ e < 3"''+\ 
and thus 

0„(A) = g|. (4.1.21) 

The map restricted to A is conjugate to the tent map 52- Indeed, with any point 
X = 0. 5162^3 • • • in A, we can associate h{x) = 0.(6i/2) (62/2) (63/2) ... in [0, 1], and the 
relations (|Tl|) and (|X|), (|T^ show that 



hogsl^oh-^ =g2. (4.1.22) 

Thus we can easily compute itineraries of points x £ A, and the conclusions on the 
behaviour of orbits of 52 can be transposed to g^l^. A is the simplest example of what is 
called a hyperbolic invariant set. 

Similar properties can be seen to hold for nonlinear perturbations of the tent map. 
Indeed, the ternary representation is a useful tool, but not essential for the existence of 
orbits with all possible symbolic representations. It is, in fact, sufficient that / maps two 
disjoint intervals /i,/2 C [0,1] onto [0,1], and maps all other points outside [0,1]. Then 
the symbolic representation corresponds to the sequence of intervals Ii or I2 visited by 
the orbit. 

4.1.2 Homoclinic Tangles and Smale's Horseshoe Map 

One-dimensional maps are rather special cases of dynamical systems, but it turns out 
that some of their properties can often be transposed to more "realistic" systems. As a 
motivating example, let us consider the equation 



Xi = X2 

±2 = xi- x\, 



(4.1.23) 



called the (undamped) unforced Duffing oscillator. This is a Hamiltonian system, with 
Hamiltonian 

H{x^,X2) = \xl + h\-]^xl (4.1.24) 



H \s a. constant of the motion, and thus orbits of ( 4.1.23| ) belong to level curves of H 



(Fig. [4.2| a). The point (0,0) is a hyperbolic equilibrium, with the particularity that its 
unstable and stable manifolds and are identical: they form the curve H = 0, and 
are called homoclinic loops. 
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Figure 4.2. (a) Orbits of Duffing's equation for e 
obtained for e = 0.25. 
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0, (b) one orbit of the Poincare map 



Let us now perturb ( 4.1.23D by a periodic forcing, 



Xl = X2 

X2 = xi — xf + e sin(27rt) . 
We can introduce x^ = t as additional variable to obtain the autonomous system 



(4.1.25) 



Xl = X2 

±2 = Xl — xf + esin(27rx3) 
±3 = 1. 



(4.1.26) 



Here X3 G § ^ should be considered as a periodic variable. We can thus use the surface 



X3 = as a Poincare section. Fig. [4.2| b shows an orbit of the Poincare map, which has a 
complicated structure: it seems to fill a two-dimensional region, in which its dynamics is 
quite random. 

This phenomenon can be explained at least partially, by analysing the properties of the 
Poincare map Pg. First observe that the system ( 4.1.260 is conservative. The section being 
perpendicular to the flow, the Poincare map is also conservative. When e = 0, Pq = fi 
is the time-one flow of ( 4.1.23| ), and thus Pq admits the origin as hyperbolic fixed point. 
The implicit function theorem implies that for small e, P^ admits an isolated hyperbolic 
fixed point x*(e) near (0,0). It is unlikely that the stable and unstable manifolds of x*{e) 
still form a loop when e > 0, and if not, they must intersect transversally at some point xq 
because of area conservation, xq is called a homoclinic point. A method due to Melnikov 
allows to prove that such a transverse intersection indeed exists. 

Consider now the successive images x„ = P"(xo). Since xq belongs to the stable 
manifold of x*(e), all x„ must also belong to W^, and they must accumulate at 
X* for n — > cxD. Similarly, since xq belongs to the unstable manifold VF", all x„ must 
belong to and accumulate at x* for n — > —00. Thus and must intersect 
infinitely often. Because the map is area preserving, the area between W^, VK", and 
any consecutive intersection points must be the same, and thus has to oscillate with 
increasing amplitude when approaching x* (Fig. ^I^ ). has a similar behaviour. This 
complicated geometrical structure, which was first described by Poincare, is called the 
homoclinic tangle. 

The dynamics near the homoclinic tangle can be described as follows. Let Q be a small 
rectangle, containing a piece of unstable manifold and two points X-m, X-m+i of the 
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homoclinic orbit (Fig. |4.4| ) . At least during the first iterations of , Q will be stretched 
in the unstable direction, and contracted in the stable one. After m iterations, the image 
P^{Q) contains xq and xi. Let n be sufficiently large that the points x„ and Xn+i of the 
homoclinic orbit are close to x*. Due to area conservation, one can arrange that the piece 
of between x„ and crosses Q at least twice, and so does the image Pp^'^(Q). 

This behaviour is reproduced qualitatively by the Smale horseshoe map (Fig. |4.5| ). This 
map T takes a square [0, 1] x [0, 1], stretches it vertically by a factor > 2, and contracts 
it horizontally by a factor A < 1/2. Then it bends the resulting rectangle in the shape of a 
horseshoe, and superimposes it with the initial square. Two horizontal strips H^ and H^, 
of size 1 X are mapped, respectively, to two vertical strips V+ and V-, of size A x 1. 
For simplicity, the map restricted to V+ U V- is assumed to be linear, but its qualitative 
features can be shown to remain unchanged by small nonlinear perturbations. 

The aim is now to construct an invariant set A of T. To this end, we observe that 
T{x) G Q if and only if x e U H+. Since T{x) G y_ U V+, T'^{x) G Q if and only if 
T{x) belongs to one of the four rectangles F^pe^ = V^q CiH^-^, where eo,ei G {— , +}. These 
rectangles have size A x fi^^. The preimage of each Fep^-^ is a rectangle -f^eo^i 
size 1 X fi~'^. The image of F^ge^ is a rectangle V^ge^ C V"e^, of size A^ x 1. Thus maps 

Heoei to Veoei- 

More generally, we can define 

i^.oei....„ = {xeQ:xe H,,,T{x) G H,,, . . . ,T^{x) G (4.1.27) 

Note that Heoei...e„ C Hso...e„^i, and that 

^eo.i...e„ = {xe H,, : T(x) G H,„„,^}. (4.1.28) 

By induction, it is straightforward to show that ifeQe^^...^^ is a rectangle of size 1 x /i"". 
Similarly, we introduce 

= {x G Q: T-Hx) G H,_,,. . .,T~^{x) G H,_J 

= {x G Vs_, : T~\x) G J, (4.1.29) 

which is a rectangle of size A™ x 1 contained in V^_„+i...£_i • It follows that 

^£-m---e-i,eoei...£„ = ^_m...e_i H 

= {x eQ: T\x) G Hs^,-m ^ j ^ n} (4.1.30) 
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Xq 



Figure 4.4. Schematic representation of the homoclinic tangle. The homoclinic orbit 

{xn}nei, is asymptotic to x* for n ztoo. One can choose m and n in such a way that 
the image of a rectangle Q after m + n iterations intersects Q twice. 
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Figure 4.5. The horseshoe map T maps the rectangles H± of the unit square Q to the 
rectangles V±. If Tsae^ = n H^^, one also has T{Hs„ei) = ^eoei and T{rsoei) = Koei- 



is a rectangle of size x By construction, T^{x) G Q for —m ^ j ^ n + 1 if and 

only if a; G ^e-m-,£o-£n some sequence . . . , Sq . . . Sn of symbols —1 and +1. 

Now let n, m go to oo. Let S be the set of bi-infinite sequences £ = ... e_i, sq^i ■ • ■ of 
symbols —1 and +1. It is a metric space for the distance 



(4.1.31) 
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Figure 4.6. Successive approximations of the invariant set A. 



From (4.1.30) we conclude that the largest subset of Q invariant under T is 

A= fl r"(Q) = {r,: ee S}, (4.1.32) 

ra=— oo 

where Fg , defined as the limit of ( [4.1.3C| ) when the finite sequence e_m ■ ■ ■ ,£o ■ ■ ■ £n con- 
verges to e, is a single point. A is a Cantor set, obtained by taking the product of two 
one-dimensional Cantor sets. The map (/> : e i— > F^ is a bijection from T, to A, which is con- 
tinuous in the topology defined by ( 4.1.3l| ). It follows from ( 4.1.30D that T is conjugated 



to the shift map 

o- = o o (/):.. . e_2e-i, £0^1 . . . ^ . . . e-ieo, £1^2 ■ ■ ■ (4.1.33) 

This conjugacy can be used to describe the various orbits of in a similar way as we did 
for the tent map. In particular, periodic itineraries e correspond to periodic orbits of T, 
aperiodic itineraries correspond to chaotic orbits. Smale has shown that these qualitative 
properties are robust under small perturbations of T: 

Theorem 4.1.4 (Smale). The horseshoe map T has an invariant Cantor set A such 
that 

• A contains a countable set of periodic orbits of arbitrarily long periods; 

• A contains an uncountable set of bounded nonperiodic orbits; 

• A contains a dense orbit. 

Moreover, any map T sufficiently close to T in the topology has an invariant Cantor 
set A with r|~ topologically equivalent to T\^. 

The example of the horseshoe map can be generalised to a class of so-called axiom A 
systems with similar chaotic properties. These systems can be used to show the existence 
of chaotic orbits in a large class of dynamical systems, including (but not limited to) those 
with a transverse homoclinic intersection. 

Note that the examples of hyperbolic invariant sets that we have encountered have 
measure zero and are not attracting. Showing the existence of invariant sets containing 
chaotic orbits and attracting nearby orbits is a much more difficult task. 
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4.2 Strange Attractors 

4.2.1 Attracting Sets and Attractors 

We consider in this section a dynamical system on P C M", defined by a flow ipt. One can 
include the case of iterated maps by restricting t to integer values and setting ipt = F^. 
Various subsets of V can be associated with the flow. 

Definition 4.2.1. 

• A subset S C T> is called invariant if (pt{S) = S for all t. 

• A subset A CT> is called an attracting set if there exists a neighbourhood U of A such 
that for all x gU, ipt{x) E U for all t and ipt{x) A as t ^ oo. 

• A point X is nonwandering for (ft if for every neighbourhood U of x and every T > 0, 
there exists a t > T such that ipt{U) nZ^ 7^ 0. The set of all nonwandering points is 
the nonwandering set 0. 

These sets can be partly determined by looking at the asymptotic behaviour of various 
orbits of the flow. 

Definition 4.2.2. The uo-limit set of x for ipt is the set of y € T> such that there exists a 
sequence — > 00 with (pt„{x) y. The a-limit set of x for ipt is the set of y £ V such 
that there exists a sequence tn —00 with (pt„{x) — > y. 

The a- and w-limit sets of any x are invariant sets, and the w-limit set is included in the 
nonwandering set. One can show that asymptotically stable equilibrium points, periodic 
orbits, and invariant tori are all tj-limit sets of the orbits in their basin of attraction, 
nonwandering sets and attracting sets. There is, however, a problem with the deflnition 
of attracting set, as shows the following example. 

Example 4.2.3. Consider the differential equation 

^ (4.2.1) 

X2 = -X2. 

The w-limit set of x is (-1,0) if xi < 0, (0,0) if xi = and (1,0) if xi > 0. (0,0) is 
also the a-limit set of all points in (—1,1) x {0}. The nonwandering set is composed of 

the three equilibrium points of the flow, while (±1,0) are attracting sets. However, the 
segment [—1, 1] x {0} is also an attracting set. 

One would like to exclude attracting sets such as the segment [—1,1] x {0} in the 
example, which contains wandering points. This is generally solved in the following way. 

Definition 4.2.4. A closed invariant set A is topologically transitive if ipt has an orbit 
which is dense in A. An attractor is a topologically transitive attracting set. 

Remark 4.2.5. Sometimes, one uses a weaker notion of indecomposability than topolog- 
ical transitivity, based on the notion of chain recurrence. In this case, one requires that 
for any pair of points x,y and any e > 0, there exist points xq = x, xi, . . . , x^ = y and 
times ti, . . . ,tn such that — Xj\\ ^ e for all j. 



Remark 4.2.6. A slightly weaker definition of attractor is proposed in | GH83 |: An at- 
tractor is an indecomposable closed invariant set A with the property that, given e > 0, 
there is a set U of positive Lebesgue measure in the e-neighbourhood of A such that, if 
X GU, the forward orbit of x is contained in U and the w-limit set of x is contained in A. 
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4.2.2 Sensitive Dependence on Initial Conditions 

A strange attractor is, basically, an attractor on which the dynamics is chaotic. Obviously, 



this requires that we define what we mean by "chaotic". In | GH83 |, for instance, a strange 



attractor is defined as an attractor containing a transversal homoclinic orbit. As we saw 



in section 4.1.2 , the existence of such an orbit implies various chaotic properties (it is not 
necessary to assume that the system is conservative). Modern definitions are a bit less 
specific, they require that the dynamics be sensitive to initial conditions: 

Definition 4.2.7. Let A be a compact set such that 'fti-^) C A for all t ^ 0. 

• The flow (ft is said to have sensitive dependence on initial conditions on A if there 
exists e > with the following property: For any x £ A and any neighbourhood U of 
X, there exists y £U and t > such that \\^pt{x) — iptiy)\\ ^ £■ 

• A is a strange attractor if it is an attractor and ipt has sensitive dependence on initial 
conditions on A. 

Exercise 4-3- Show that the tent map and Smale's horseshoe map have sensitive depen- 
dence on initial conditions. 

Sensitive dependence on initial conditions requires that for any point x, one can find 
an arbitrarily close point y such that the orbits of x and y diverge from each other (the 
quantity e should not depend on ||x — y||, though t may depend on it). This is a rather 
weak property, and one often requires that the divergence occur at an exponential rate. 

Definition 4.2.8. 

• Assume ipt is the flow of a differential equation x = f{x). Let x £ T> and let U{t) be 
the principal solution of the equation linearized around the orbit of x, 

y = %Wt{x))y. (4.2.2) 



Oseledec i Os6^J proved that under quite weak assumptions on f , the limit 



L = ^lkn llog(C/(t)^t/(t)) (4.2.3) 

exists. The eigenvalues of L are called the Liapunov exponents of the orbit of x. 
If F is an iterated map and {xk} is a given orbit of F, consider the linear equation 

dF OF dF 

yk+i = -Q^{xk)yk =^ yk = Ukyo, Uk = -Q^{xk-i) ■ ■ ■ -q^{xq). (4.2.4) 

The Liapunov exponents of the orbit {x^} are the eigenvalues of 



1 



L= hm -log(C/JC/fc). (4.2.5) 

Note that U{t)'^U(t) is a symmetric positive definite matrix, and hence it is always 
diagonalizable and has real eigenvalues. This definition implies that the solution y(t) of 
the equation linearized around the particular solution (/7t(a;) satisfies 

\\y{t)f = \\Uit)y{0)f = y(0) • [/(t)^C/(t)y(0) ^ y(0) • e^*^ y(0). (4.2.6) 

Let Ai be the largest eigenvalue of L. Unless the projection of y{0) on the eigenspace of 
L associated with Ai is zero, ||y(t)|| will grow asymptotically like e'^^*. We thus say that 
the flow has exponentially sensitive dependence on initial conditions in A if the largest 
Liapunov exponent of all orbits in A is positive. 
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Proposition 4.2.9. 

• // ipt is conservative, then the sum of all Liapunov exponents of any orbit is zero. 

• // the flow is dissipative, then this sum is negative. 

• Assume {iptix)} is an orbit of the differential equation x = f{x), such that \\f\\ is 
bounded below and above by strictly positive constants on {ipt{x)}. Then this orbit has 
at least one Liapunov exponent equal to zero. 

Proof: We saw in the proof of Proposition |2.1.1C| that the determinant of U{t) is constant 
if the system is conservative, and decreasing if the system is dissipative. By definition, 
det C/(0) = 1 and by uniqueness of solutions, det U{t) > for all t. Thus for f > 0, the 
product of all eigenvalues of U{t) is equal to 1 in the conservative case, and belongs to 
(0, 1) in the dissipative case. The same is true for det C/(t)"^C/(t). But for any matrix 
dete-^ = e""^^ because the eigenvalues of e^ are exponentials of the eigenvalues of B. 
Assume now x{t) = '^t{x) is a solution of x = f{x). Then 

^^x{t) = ^^f{ipt{x)) = ^{ipt{x))x{t), 
and thus x{t) = U(t)x{0) by definition of U{t). Hence, 

m ■ U{tfU{t)x{0) = \\U{t)±{0)f = \\±{t)f = \\f{Mx))f. 
By the assumption on ||/||, it follows that as t ^ oo, the function 

i(0) • e2*^x(0) 

is bounded above and below by strictly positive constants. Being symmetric, L admits an 
orthonormal set of eigenvectors ui, . . . ,Un, that is, they satisfy Ui ■ Uj = 5ij . If Cj = Uj • x(0) , 
then x{0) = CjUj and thus 



x(0) • e^*^ x(0) = e' 



2Xjt 



Since x{0) ^ 0, at least one of the coefficients, say c^, is different from zero, and thus 
must be equal to zero. □ 

It is easy to find systems with positive Liapunov exponents. Consider for instance the 
linear system x = Ax. In this case, U{t) = e"^* and one shows (using, for instance, the 
Jordan canonical form of A), that the Liapunov exponents are exactly the real parts of 
the eigenvalues of A. Thus if A has an eigenvalue with positive real part, all orbits have 
exponentially sensitive dependence on initial conditions. 

More generally, if x* is a linearly unstable equilibrium point, its largest Liapunov 
exponent will be positive. Similarly, if F is a periodic orbit, then we have seen in Theorem 
2.3.2 that U{t) = P{t)e^^, where P{t) is periodic. The Liapunov exponents are the real 
parts of the eigenvalues of B, that is, the real parts of the characteristic exponents, e^* 
has at least one eigenvalue equal to 1, corresponding to translations along the periodic 
orbit (seen in Proposition 2.3.5| ). Thus one of the Liapunov exponents is equal to zero. 



More generally, orbits on an invariant torus of dimension m will have at least m Liapunov 
exponents equal to zero. If one or more of the remaining exponents are positive, then the 
periodic or quasiperiodic orbits on the torus will depend sensitively on initial conditions. 
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Attractor 


Sign of Liapunov exponents 


Asymptotic dynamics 


Stable equilibrium 


(-,-,-) 


Stationary 


Stable periodic orbit 


(0,-,-) 


Periodic 


Attracting torus 


(0,0,-) 


Quasiperiodic 


Strange attractor 


(+,0,-) 


Chaotic 



Table 4.1. Examples of attractors of a three-dimensional flow. 



However, all the above invariant sets (equilibrium, periodic orbit or torus) must be unstable 
in order to have sensitive dependence on initial conditions, and thus they have zero measure 
and are not attractors. Orbits starting near these sets will not necessarily have positive 
Liapunov exponents. 

By contrast, orbits of a strange attractor must attract all nearby orbits that do not 
belong to the attractor, while they repel nearby orbits that do belong to it. In order to 
attract nearby orbits, the flow must be dissipative in a neighbourhood of the attractor, so 



that by Proposition 4.2.E , the sum of all Liapunov exponents must be negative. Since orbits 
on the attractor are bounded and not attracted by an equilibrium point, one Liapunov 
exponent is equal to zero. Hence a two-dimensional flow cannot admit a strange attractor]^ 
If a three-dimensional flow has a strange attractor, its Liapunov exponents must satisfy 



Ai > A2 = > A3 and IA3I > Ai (see Table 4T). Because of volume contraction, the 
attractor must have zero volume, but it cannot be a surface and have positive Liapunov 
exponents. This accounts for the fractal nature of many observed attractors. 

For iterated maps, the situation is less restrictive, since their orbits need not have one 
Liapunov exponent equal to zero. Thus two-dimensional dissipative maps may admit a 
strange attractor, with Liapunov exponents satisfying IA2I > Ai > > A2- For instance, 
the intersection of the strange attractor of a three-dimensional flow with a Poincare sec- 
tion is also a strange attractor of the associated two-dimensional Poincare map. One- 
dimensional iterated maps may have strange attractors if they are non-invertible. 

4.2.3 The Henon and Lorenz Attractors 

The first dynamical system for which the existence of a strange attractor was proved is 
the Henon map 

Xk+i = 1 - Xxl + yk 
Vk+i = bxk- 

This map does not describe a physical system. It has been introduced as a two-dimensional 
generalization of the one-dimensional map Xk+i = 1 — Ax|, which is equivalent to the 
logistic map. When 6 = 0, ( [4.2.7 ) is reduced to this one-dimensional map. If 6 7^ 0, the 



Henon map is invertible, and it is dissipative if |6| < 1. Numerical simulations indicate 
that for some parameter values, the Henon map has indeed a strange attractor with a 
self-similar structure (Fig. 4.7). 



■^A theorem due to Poincare and Bendixson states that a non-empty compact u)- or a-limit set of a 
planar flow is either a periodic orbit, or contains equiUbrium points, which also rules out the existence of 
strange attractors for two-dimensional flows. 




Theorem 4.2.10 (Benedicks, Carleson | BC91| ). Let z* = {x*,y*) be the fixed point 



of ( |4.2.7 ) with X*, y* > 0, and let be its unstable manifold. For all c < log 2, there is 



a set of positive Lebesgue measure of parameters (6, A) for which 

1. there is an open set ^ C M^, depending on A and b, such that for all z £ U, 

T''{z)^W^ as fc^oo; (4.2.8) 

2. there is a point zq G such that 

(a) the positive orbit of zq is dense in W^; 

(b) the largest Liapunov exponent of the orbit of zq is larger than c. 

Hence the closure of the unstable manifold is a strange attractor. Locally, the 
strange attractor is smooth in the unstable direction (with positive Liapunov exponent), 
and has the structure of a Cantor set in the transverse, stable direction (with negative 
Liapunov exponent). 
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As a final illustration, we return to the Lorenz equations 

±1 = a{x2 - xi) 

X2 = rxi — X2 — X1X3 (4.2.9) 
±3 = -6x3 + X1X2. 

The existence of a strange attractor for this system has not been proved to our knowl- 
edge, although there is strong numerical evidence that such an attractor exists for certain 
parameter values, including in particular a = 10, b = 8/3 and r = 28. The qualitative 
properties of dynamics are nonetheless quite well understood (see for instance [ pp82| ]). 
The strange attractor seems to appear after a rather subtle sequence of bifurcations. Let 
us consider the case a = 10, b = 8/3, and take r as bifurcation parameter. 

1. For ^ r ^ 1, the origin is globally asymptotically stable, that is, all orbits converge 
to the origin (c.f. Exercise 2.3). 



2. At r = 1, the origin undergoes a pitchfork bifurcation (c.f. Exercise |3.1| ), and two 
new stable equilibria C± = {±y/b{r — 1), iby^6(r — 1), r — 1) appear. These points 
become unstable in a Hopf bifurcation at r = ^ ~ 24.74 (c.f. Exercise ^.2| ). The 
Hopf bifurcation is subcritical, and thus corresponds to the destruction of an unstable 
periodic orbit, that must have been created somehow for a smaller value of r. 

The dynamics for r > 1 can be described by taking a Poincare section on the surface 
T, : X3 = r — 1 (we only take into account intersections with X3 < 0). Consider a 
rectangle containing the segment C_ C+ and the intersection 5 of the two-dimensional 
stable manifold of the origin with S (Fig. |4.8| ). S is attracted by the origin, which has 
the effect to pinch the rectangle and map it to two pieces of triangular shape. One 
vertice of each triangle belongs to a piece of the one-dimensional unstable manifold 
of the origin. Due to the dissipation, the angle at this vertice is quite small. In 
first approximation, the dynamics can thus be described by a one-dimensional map 
for a coordinate transverse to S, parametrizing the long side of the triangles. For r 
sufficiently small, this map is increasing, discontinuous at 0, and admits two stable 
fixed points c± corresponding to C± (Fig. |4.8| a). 

3. At r = ri ~ 13.296, a homoclinic bifurcation occurs (Fig. ^^b): the unstable manifold 

belongs to the stable manifold W^, and thus the sharpest vertices of both triangles 
belong to S. The one-dimensional approximation of the Poincare map is continuous, 
but still monotonously increasing. 

4. For r slightly larger than ri, each piece of hits S on the opposite side of S 
(Fig. |4.8| c). The one-dimensional map becomes non-invertible, and has two new un- 
stable equilibria 6_ and 64.. The map does not leave the interval invariant, 
but maps two of its subintervals onto 6+]. The situation is thus similar to that of 
the tent map g^: there exists an invariant Cantor set containing chaotic orbits. The 
same can be seen to hold for the two-dimensional Poincare map, which resembles the 
horseshoe map. Thus there exists a strange nonwandering set A, but it is repelling 
and has zero measure (thus it is difficult to observe numerically). 

5. As r increases, the fixed points b± move towards the fixed points c±. It appears 
that for r ^ r2 — 24.06, the interval is mapped into itself (Fig. [4.8| d). The 
strange nonwandering set A becomes attracting, although it does not yet attract a full 
neighbourhood, since orbits starting in b± may converge to c±. 

6. The subcritical Hopf bifurcation at r = ~ 24.74 makes the fixed points C± unstable, 
so that finally all orbits can converge to the nonwandering set A, which has become 
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Figure 4.8. Schematic representation of the stable and unstable manifolds of the Lorenz 
equations (left), and one-dimensional approximation of the Poincare map for the coordinate 
perpendicular to (right), (a) 1 < r < ri, (b) homoclinic bifurcation at r = ri, (c) 
existence of a nonwandering repeller for n < r < r2, and (d) bifurcation to a strange 
attractor at r = r2. 
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an attractor. 

The method used here to describe the dynamics near a homocUnic bifurcation by a 
Poincare map has been apphed to other systems. Transitions to chaotic behaviour are 
quite frequently associated with such homocHnic bifurcations. The Poincare map in a 
vicinity of the unstable manifold is described as the composition of an almost linear map, 
reflecting the motion near the equilibrium point, and a nonlinear, but usually rather simple 
map, reflecting the motion near away from the equilibrium. The composition of two 
rather innocent-looking maps contains all the ingredients necessary for the existence of 
chaotic dynamics. 
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